00000001:02000400:1.0F:1784937974.419083:0:3293:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1784937991.441512:0:3516:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1784937993.490927:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 451 MB/s 00000001:01000000:3.0F:1784937993.740602:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 783 MB/s 00000001:01000000:1.0:1784937993.990691:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3923 MB/s 00000020:02000000:1.0:1784937994.925272:0:3609:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_203_ga89eac3 00000400:02000000:0.0F:1784937996.013984:0:3624:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.126@tcp [8/256/0/180] 00008000:02000000:1.0:1784938000.039524:0:3774:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1784938058.585797:0:5740:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784938071.523097:0:6490:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:0.0:1784938071.523103:0:6490:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784938071.523105:0:6490:0:(obd_mount.c:925:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784938071.524491:0:6490:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000094d6f938 00000080:02000400:0.0:1784938071.524503:0:6490:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1784938071.535561:0:6490:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1784938071.535573:0:6490:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784938071.535600:0:6490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000be913ed7) 00000020:00000080:0.0:1784938071.535692:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784938071.609636:0:6490:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784938071.609733:0:6490:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1784938071.633521:0:6490:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784938071.633911:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784938071.633921:0:6490:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784938071.634001:0:6490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59edd81 00000020:01000004:2.0:1784938071.634012:0:6490:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1784938071.634018:0:6490:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784938071.634024:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000094d6f938 from MGS 00000020:01000004:2.0:1784938071.634030:0:6490:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784938071.634057:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f955951c) 00000020:00000080:2.0:1784938071.634082:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1784938071.634494:0:6490:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000094d6f938 from MGS, refs=2 00080000:01000000:2.0:1784938071.634502:0:6490:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784938071.634511:0:6490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59edd8f 00000100:00100000:2.0:1784938071.634725:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1784938071.634909:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1784938071.634917:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1784938071.637499:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1784938071.637556:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1784938071.641612:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938071.641835:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1784938071.641843:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784938071.645737:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784938071.645758:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1784938071.646602:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1784938071.646612:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784938071.647507:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938071.647511:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938071.647513:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938071.647767:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938071.647770:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938071.647772:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938071.648545:0:6490:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784938071.651866:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1784938071.897147:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2299 MB/s 00000001:01000000:1.0:1784938072.146331:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2075 MB/s 00000001:01000000:3.0:1784938072.396694:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 395 MB/s 00000001:01000000:0.0:1784938072.646861:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 419 MB/s 00080000:10000000:3.0:1784938072.651816:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1784938072.670710:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:2.0:1784938072.671649:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784938072.671691:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784938072.671713:0:6490:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784938072.671746:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1784938072.671893:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1784938072.671922:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784938072.676988:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938072.677205:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784938072.677253:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784938072.678211:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784938072.678242:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784938072.678653:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784938072.678659:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784938072.679759:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784938072.679783:0:6490:0:(obd_mount.c:414:lustre_start_mgc()) Start MGC 'MGC192.168.203.126@tcp' 00000020:01000004:3.0:1784938072.679785:0:6490:0:(obd_mount.c:423:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784938072.679904:0:6490:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGC192.168.203.126@tcp (typ=mgc) 00000020:00000080:3.0:1784938072.679921:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.126@tcp (0000000049ff70fc) 00000020:00000080:3.0:1784938072.679936:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784938072.680053:0:6490:0:(ldlm_lib.c:125:import_set_conn()) imp 00000000cfd80a22@MGC192.168.203.126@tcp: add connection 0@lo at head 00000100:00080000:2.0:1784938072.680317:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1784938072.680435:0:6490:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.126@tcp-0 is initialized 00000040:01000000:3.0:1784938072.680440:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 1 is initialized 10000000:01000000:0.0:1784938072.688960:0:6510:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784938072.689269:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.126@tcp (uuid 7782ae5c-cb83-4240-bccc-1dc097db054d) 00000020:00000080:2.0:1784938072.689294:0:6490:0:(genops.c:1406:class_connect()) connect: client 7782ae5c-cb83-4240-bccc-1dc097db054d, cookie 0x26783cd1c59edd9d 00000100:00080000:2.0:1784938072.689305:0:6490:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784938072.689310:0:6490:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import 00000000cfd80a22 using connection 7782ae5c-cb83-4240-bccc-1dc097db054d/0@lo 00000100:00100000:2.0:1784938072.689350:0:6490:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a37cbca x1871643144093824/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938072.689372:0:6490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS 00000020:01000004:2.0:1784938072.689388:0:6490:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784938072.689394:0:6490:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784938072.689406:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000370acbab) 00000020:00000080:2.0:1784938072.689417:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784938072.691490:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008a37cbca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7782ae5c-cb83-4240-bccc-1dc097db054d:3639:1871643144093824:0@lo:250: 00000100:00100000:0.0:1784938072.691568:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938072.691651:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144093824 00000100:00100000:0.0:1784938072.691659:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144093824 00000100:00100000:0.0:1784938072.691687:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938072.691693:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ed8bcd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1871643144093824:12345-0@lo:250: 00010000:00080000:0.0:1784938072.691729:0:6505:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 7782ae5c-cb83-4240-bccc-1dc097db054d@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:0.0:1784938072.691755:0:6505:0:(genops.c:1406:class_connect()) connect: client 7782ae5c-cb83-4240-bccc-1dc097db054d, cookie 0x26783cd1c59eddab 00000100:00080000:0.0:1784938072.691865:0:6505:0:(import.c:65:import_set_state_nolock()) 00000000266464f0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938072.691913:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ed8bcd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+5:3639:x1871643144093824:12345-0@lo:250: Request processed in 219us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938072.691920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938072.691961:0:3639:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784938072.691969:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.126@tcp: connect to target with instance 0 00000100:00080000:0.0:1784938072.691975:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784938072.691984:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784938072.691987:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000cfd80a22 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784938072.691990:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784938072.691998:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784938072.692001:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008a37cbca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7782ae5c-cb83-4240-bccc-1dc097db054d:3639:1871643144093824:0@lo:250: 00000100:00100000:2.0:1784938072.713494:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938072.713748:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1784938072.713755:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784938072.715790:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1784938072.715803:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784938072.716645:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784938072.716653:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1784938072.717853:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938072.718007:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1784938072.718012:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784938072.721941:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784938072.721953:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784938072.805549:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938072.805724:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784938072.805730:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1784938072.806905:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784938072.806915:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784938072.808142:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938072.808523:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784938072.808530:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784938072.809054:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784938072.809061:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784938072.809751:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938072.809876:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784938072.809880:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784938072.813440:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784938072.813453:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784938072.814022:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938072.814389:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784938072.814395:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784938072.814818:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784938072.814823:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1784938072.838833:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938072.839003:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784938072.839010:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1784938072.843077:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784938072.843091:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1784938072.846027:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784938072.846044:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1784938072.847839:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1784938072.847868:0:6490:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784938072.847873:0:6490:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784938072.847968:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784938072.848005:0:6490:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1784938072.848010:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784938072.848011:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938072.848012:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938072.848013:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938072.848014:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938072.848016:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938072.848017:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938072.848018:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938072.848019:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938072.848020:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938072.848022:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938072.848023:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938072.848025:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1784938072.848027:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938072.848029:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938072.848030:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938072.848031:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938072.848032:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938072.848033:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938072.848034:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938072.848035:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938072.848036:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938072.848036:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938072.848037:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938072.848038:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938072.848075:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784938072.848091:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000291c81a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144093952:0@lo:253: 00000100:00100000:0.0:1784938072.848459:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938072.848544:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 00000000de4a39fe going to sleep for 11 seconds 00000100:00100000:3.0:1784938072.848646:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144093952 00000100:00100000:3.0:1784938072.848653:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144093952 00000100:00100000:3.0:1784938072.848727:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938072.848735:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0c4e144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+5:6490:x1871643144093952:12345-0@lo:253: 20000000:01000000:3.0:1784938072.848776:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784938072.848779:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1784938072.849052:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1784938072.849110:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1784938072.849403:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938072.850809:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1784938072.850989:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784938072.850993:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1784938072.850999:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1784938072.851001:0:6507:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1784938072.851013:0:6507:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1784938072.851468:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938072.851592:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1784938072.851606:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784938072.851620:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1784938072.851636:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1784938072.851647:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1784938072.851690:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1784938072.851696:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1784938072.851707:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1784938072.851710:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1784938072.851720:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1784938072.851724:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1784938072.851733:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1784938072.851746:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1784938072.851765:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784938072.851769:0:6507:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1784938072.851774:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938072.851847:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1784938072.851856:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784938072.851868:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1784938072.851880:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1784938072.851893:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1784938072.851901:0:6507:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1784938072.851936:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1784938072.851944:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1784938072.851955:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1784938072.851976:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1784938072.851989:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1784938072.851996:0:6507:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1784938072.852016:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1784938072.852023:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1784938072.852033:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1784938072.852045:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1784938072.852095:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1784938072.852144:0:6507:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1784938072.852151:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1784938072.852662:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1784938072.852808:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1784938072.852825:0:6507:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.126@tcp for mdt 20000000:01000000:3.0:1784938072.852826:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1784938072.852839:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1784938072.852844:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1784938072.852854:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1784938072.852858:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1784938072.852870:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1784938072.852878:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1784938072.852889:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1784938072.852903:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1784938072.852926:0:6507:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784938072.852929:0:6507:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784938072.852933:0:6507:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784938072.852968:0:6507:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784938072.852970:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784938072.853582:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1784938072.854935:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1784938072.854962:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1784938072.854996:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1784938072.855008:0:6507:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784938072.855010:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784938072.855556:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1784938072.855701:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1784938072.855722:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1784938072.855742:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1784938072.855755:0:6507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938072.855757:0:6507:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1784938072.855761:0:6507:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784938072.855764:0:6507:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784938072.855768:0:6507:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1784938072.855774:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1784938072.856038:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1784938072.856135:0:6507:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1784938072.864012:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1784938072.864050:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1784938072.864066:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1784938072.864085:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784938072.864107:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864426:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864437:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864443:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864449:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864455:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864461:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f14dfe24 already unused, calling callback (00000000d7b3c3e8) 00010000:00010000:3.0:1784938072.864464:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864470:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864482:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864503:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.864508:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddb2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784938072.864527:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784938072.887293:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0c4e144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+5:6490:x1871643144093952:12345-0@lo:253: Request processed in 38551us (38828us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938072.887308:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784938072.887579:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000291c81a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144093952:0@lo:253: 10000000:01000000:0.0:1784938072.887594:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784938072.887597:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938072.887599:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938072.887600:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938072.887602:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1784938072.887603:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938072.887604:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938072.887605:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938072.887606:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938072.887607:0:6490:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784938072.887609:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938072.887610:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784938072.887627:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000094d6f938 from lustre-MDT0000 10000000:01000000:0.0:1784938072.887655:0:6490:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784938072.887658:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784938072.887662:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff910cf3bf8000 10000000:01000000:0.0:1784938072.887666:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938072.887893:0:6490:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff910cf3bf8000 from 1 10000000:01000000:0.0:1784938072.887897:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784938072.887933:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938072.887943:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938072.887952:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938072.887969:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000291c81a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094080:0@lo:101: 00000100:00100000:0.0:1784938072.888021:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938072.888134:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef249bf3 going to sleep for 11 seconds 00000100:00100000:3.0:1784938072.889701:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144094080 00000100:00100000:3.0:1784938072.889713:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144094080 00000100:00100000:3.0:1784938072.889799:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938072.889808:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b78fddb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+5:6490:x1871643144094080:12345-0@lo:101: 00010000:00010000:3.0:1784938072.889825:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938072.889842:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59eddb9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.889865:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59eddb9 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.889874:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59eddb9 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938072.889883:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f14dfe24, rc 0) 00000100:00100000:3.0:1784938072.889953:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b78fddb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+6:6490:x1871643144094080:12345-0@lo:101: Request processed in 146us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938072.889960:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784938072.890053:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000291c81a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094080:0@lo:101: 00010000:00010000:1.0:1784938072.890078:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938072.890097:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938072.890208:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094208:0@lo:501: 00000100:00100000:1.0:1784938072.890307:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938072.893091:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc9a2417 going to sleep for 11 seconds 00000100:00100000:0.0:1784938072.893249:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144094208 00000100:00100000:0.0:1784938072.893258:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144094208 00000100:00100000:0.0:1784938072.893296:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784938072.893303:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dcc4f67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+6:6490:x1871643144094208:12345-0@lo:501: 00000100:00100000:0.0:1784938072.893403:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dcc4f67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+6:6490:x1871643144094208:12345-0@lo:501: Request processed in 101us (3097us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938072.893410:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938072.893551:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094208:0@lo:501: 10000000:01000000:1.0:1784938072.893589:0:6490:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784938072.893607:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938072.893616:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938072.893624:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910cca3c9000 10000000:01000000:1.0:1784938072.893628:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784938072.893632:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff910cca3c9000 10000000:01000000:1.0:1784938072.893635:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784938072.893637:0:6490:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff910cca3c9000 from 1 10000000:01000000:1.0:1784938072.893650:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784938072.893689:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000077e31756/0x26783cd1c59eddc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938072.893696:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000077e31756/0x26783cd1c59eddc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938072.893704:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000077e31756/0x26783cd1c59eddc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938072.893735:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094336:0@lo:101: 00000100:00100000:1.0:1784938072.893768:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938072.893785:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc9a2417 going to sleep for 11 seconds 00000100:00100000:0.0:1784938072.894378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144094336 00000100:00100000:0.0:1784938072.894385:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144094336 00000100:00100000:0.0:1784938072.894408:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938072.894413:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ec318f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+6:6490:x1871643144094336:12345-0@lo:101: 00010000:00010000:0.0:1784938072.894422:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938072.894433:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005a54298/0x26783cd1c59eddce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59eddc7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938072.894451:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005a54298/0x26783cd1c59eddce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59eddc7 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938072.894459:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005a54298/0x26783cd1c59eddce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59eddc7 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938072.894467:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005a54298, rc 0) 00000100:00100000:0.0:1784938072.894506:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ec318f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+7:6490:x1871643144094336:12345-0@lo:101: Request processed in 93us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938072.894513:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784938072.894631:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094336:0@lo:101: 00010000:00010000:1.0:1784938072.894651:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000077e31756/0x26783cd1c59eddc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938072.894659:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000077e31756/0x26783cd1c59eddc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938072.894672:0:6490:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784938072.894685:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000077e31756/0x26783cd1c59eddc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938072.894692:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000077e31756/0x26783cd1c59eddc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938072.894697:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784938072.894701:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938072.894705:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff910cca3c9000 10000000:01000000:1.0:1784938072.894707:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784938072.894710:0:6490:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784938072.894712:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784938072.894725:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938072.894731:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938072.894748:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938072.894760:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094464:0@lo:101: 00000100:00100000:1.0:1784938072.894788:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938072.894805:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc9a2417 going to sleep for 11 seconds 00000100:00100000:0.0:1784938072.894916:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144094464 00000100:00100000:0.0:1784938072.894926:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144094464 00000100:00100000:0.0:1784938072.894957:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784938072.894964:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a49d3488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+7:6490:x1871643144094464:12345-0@lo:101: 00010000:00010000:0.0:1784938072.894971:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938072.894978:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59eddd5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938072.894991:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59eddd5 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938072.894998:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59eddd5 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938072.895004:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000801e4e69, rc 0) 00000100:00100000:0.0:1784938072.895039:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a49d3488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+8:6490:x1871643144094464:12345-0@lo:101: Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938072.895046:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938072.895160:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094464:0@lo:101: 00010000:00010000:1.0:1784938072.895170:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938072.895177:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938072.895414:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094592:0@lo:501: 00000100:00100000:1.0:1784938072.895439:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938072.895458:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc9a2417 going to sleep for 11 seconds 00000100:00100000:0.0:1784938072.895501:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144094592 00000100:00100000:0.0:1784938072.895505:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144094592 00000100:00100000:0.0:1784938072.895531:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784938072.895537:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044055fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+8:6490:x1871643144094592:12345-0@lo:501: 00000100:00100000:0.0:1784938072.895646:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044055fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:6490:x1871643144094592:12345-0@lo:501: Request processed in 109us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938072.895653:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938072.895751:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094592:0@lo:501: 00000100:00100000:1.0:1784938072.895775:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094720:0@lo:503: 00000100:00100000:1.0:1784938072.895814:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938072.895840:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc9a2417 going to sleep for 11 seconds 00000100:00100000:0.0:1784938072.895885:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144094720 00000100:00100000:0.0:1784938072.895889:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144094720 00000100:00100000:0.0:1784938072.895917:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784938072.895922:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fb6b917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:6490:x1871643144094720:12345-0@lo:503: 00000100:00100000:0.0:1784938072.895992:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fb6b917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:6490:x1871643144094720:12345-0@lo:503: Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938072.896002:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784938072.896093:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144094720:0@lo:503: 00000100:00100000:0.0:1784938072.899158:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ea2b006c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:6534:1871643144094848:0@lo:502: 00000100:00100000:0.0:1784938072.899498:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938072.899545:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007ff9428 going to sleep for 11 seconds 00000100:00100000:1.0:1784938072.899669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144094848 00000100:00100000:1.0:1784938072.899683:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144094848 00000100:00100000:1.0:1784938072.899740:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938072.899748:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086bec366 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:6534:x1871643144094848:12345-0@lo:502: 00000100:00100000:1.0:1784938072.899868:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086bec366 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:6534:x1871643144094848:12345-0@lo:502: Request processed in 121us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938072.899875:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784938072.900125:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ea2b006c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:6534:1871643144094848:0@lo:502: 00000020:01000000:0.0:1784938072.900149:0:6534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938072.900159:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938072.900162:0:6534:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784938072.900166:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784938072.900169:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938072.900181:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000314c4974) 00000020:00000080:0.0:1784938072.900197:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784938072.900204:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784938072.900356:0:6534:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784938072.900363:0:6534:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59eddea 00000020:00000080:0.0:1784938072.900553:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784938072.900558:0:6534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938072.900561:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938072.900562:0:6534:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784938072.900564:0:6534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938072.900567:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938072.900569:0:6534:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784938072.900572:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938072.900578:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000ff8176f) 00000020:00000080:0.0:1784938072.900587:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784938072.900590:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784938072.900592:0:6534:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784938072.900594:0:6534:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784938072.900600:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784938072.900729:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000094d6f938 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784938072.900747:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a99cc3e4) 00000020:00000080:0.0:1784938072.900757:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784938072.900819:0:6534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784938072.900824:0:6534:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59eddff 00000020:00000080:0.0:1784938072.900913:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784938072.900919:0:6534:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784938072.900923:0:6534:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x26783cd1c59ede06 00080000:01000000:0.0:1784938072.900928:0:6534:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784938072.900931:0:6534:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ede0d 00080000:10000000:0.0:1784938072.901541:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1784938072.901805:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1784938072.908530:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1784938073.070672:0:6534:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1784938073.070971:0:6534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1784938073.077824:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1784938073.078133:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784938073.090867:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001d13d3b9) 00000020:00000080:2.0:1784938073.090888:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784938073.090961:0:6534:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784938073.090976:0:6534:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ede1b 00000020:00000080:3.0:1784938073.094564:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1784938073.095410:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1784938073.103709:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1784938073.118776:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1784938073.133493:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1784938073.143757:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1784938073.159062:0:6534:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1784938073.174731:0:6534:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x26783cd1c59ede22 00000020:00000080:2.0:1784938073.175638:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784938073.175652:0:6534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938073.175661:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938073.175663:0:6534:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784938073.175667:0:6534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938073.175671:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938073.175672:0:6534:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938073.175675:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938073.175677:0:6534:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784938073.175679:0:6534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938073.175682:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938073.175683:0:6534:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784938073.175685:0:6534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938073.175698:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938073.175699:0:6534:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784938073.175703:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784938073.175761:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1784938073.175827:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b4bda49c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:6534:1871643144094976:0@lo:502: 00000100:00100000:2.0:1784938073.175932:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938073.175998:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set 00000000973f6efa going to sleep for 11 seconds 00000100:00100000:1.0:1784938073.176007:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144094976 00000100:00100000:1.0:1784938073.176021:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144094976 00000100:00100000:1.0:1784938073.176077:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784938073.176085:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b778c1b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:6534:x1871643144094976:12345-0@lo:502: 00000100:00100000:1.0:1784938073.176428:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b778c1b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:6534:x1871643144094976:12345-0@lo:502: Request processed in 344us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938073.176436:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938073.177092:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b4bda49c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:6534:1871643144094976:0@lo:502: 00000020:01000000:2.0:1784938073.177146:0:6534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938073.177155:0:6534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938073.177158:0:6534:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1784938073.177162:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1784938073.177309:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1784938073.177345:0:6490:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784938073.177399:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.177411:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938073.177419:0:6490:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cca3c9000 from 1 10000000:01000000:1.0:1784938073.177421:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938073.177454:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.177461:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.177470:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938073.177501:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095104:0@lo:101: 00000100:00100000:1.0:1784938073.177555:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938073.177587:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 000000005f2967ac going to sleep for 11 seconds 00000100:00100000:2.0:1784938073.178578:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144095104 00000100:00100000:2.0:1784938073.178591:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144095104 00000100:00100000:2.0:1784938073.178657:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784938073.178666:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068165430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+9:6490:x1871643144095104:12345-0@lo:101: 00010000:00010000:2.0:1784938073.178685:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938073.178709:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ede29 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938073.178737:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ede29 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938073.178748:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ede29 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938073.178758:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001be03fee, rc 0) 00000100:00100000:2.0:1784938073.178823:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068165430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+10:6490:x1871643144095104:12345-0@lo:101: Request processed in 159us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938073.178844:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784938073.179313:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095104:0@lo:101: 00010000:00010000:1.0:1784938073.179338:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.179349:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938073.180018:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095232:0@lo:256: 00000100:00100000:1.0:1784938073.180077:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938073.180390:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 000000005f2967ac going to sleep for 11 seconds 00000100:00100000:2.0:1784938073.180627:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144095232 00000100:00100000:2.0:1784938073.180640:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144095232 00000100:00100000:2.0:1784938073.180697:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784938073.180706:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ee448cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+10:6490:x1871643144095232:12345-0@lo:256: 20000000:01000000:2.0:1784938073.180734:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784938073.180743:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784938073.180865:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ee448cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+10:6490:x1871643144095232:12345-0@lo:256: Request processed in 161us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938073.180874:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784938073.180918:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095232:0@lo:256: 10000000:01000000:1.0:1784938073.181809:0:6490:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938073.181866:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.181877:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938073.181884:0:6490:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cca3c9000 from 1 10000000:01000000:1.0:1784938073.181887:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938073.181916:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.181923:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.181938:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938073.181952:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095360:0@lo:101: 00000100:00100000:1.0:1784938073.181997:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938073.182034:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 000000005f2967ac going to sleep for 11 seconds 00000100:00100000:3.0:1784938073.184050:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144095360 00000100:00100000:3.0:1784938073.184064:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144095360 00000100:00100000:3.0:1784938073.184152:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938073.184160:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f539c41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+10:6490:x1871643144095360:12345-0@lo:101: 00010000:00010000:3.0:1784938073.184176:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938073.184191:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ede37 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.184237:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ede37 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.184246:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ede37 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.184255:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000829e9691, rc 0) 00000100:00100000:3.0:1784938073.184312:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f539c41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+11:6490:x1871643144095360:12345-0@lo:101: Request processed in 152us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938073.184318:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784938073.184460:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095360:0@lo:101: 00010000:00010000:1.0:1784938073.184477:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.184485:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938073.184562:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095488:0@lo:501: 00000100:00100000:1.0:1784938073.184594:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938073.184625:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 000000005f2967ac going to sleep for 11 seconds 00000100:00100000:3.0:1784938073.184731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144095488 00000100:00100000:3.0:1784938073.184737:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144095488 00000100:00100000:3.0:1784938073.184769:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784938073.184775:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c0d6237 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+11:6490:x1871643144095488:12345-0@lo:501: 00000100:00100000:3.0:1784938073.184917:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c0d6237 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+11:6490:x1871643144095488:12345-0@lo:501: Request processed in 142us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938073.184925:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784938073.185762:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095488:0@lo:501: 00000100:00100000:1.0:1784938073.185796:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095616:0@lo:503: 00000100:00100000:1.0:1784938073.185847:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938073.185877:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 000000005f2967ac going to sleep for 11 seconds 00000100:00100000:2.0:1784938073.186908:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144095616 00000100:00100000:2.0:1784938073.186924:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144095616 00000100:00100000:2.0:1784938073.186991:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784938073.186999:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cffb786 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+11:6490:x1871643144095616:12345-0@lo:503: 00000040:00080000:2.0:1784938073.187070:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938073.187183:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cffb786 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+11:6490:x1871643144095616:12345-0@lo:503: Request processed in 184us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938073.187192:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784938073.187326:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095616:0@lo:503: 00000040:00080000:1.0:1784938073.190062:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1784938073.190338:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1784938073.190360:0:6490:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938073.195841:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.195859:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938073.195952:0:6490:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784938073.195955:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910cca3c9000 10000000:01000000:3.0:1784938073.195959:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910cca3c9000 10000000:01000000:3.0:1784938073.195962:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938073.195968:0:6490:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cca3c9000 from 1 10000000:01000000:3.0:1784938073.195971:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938073.196018:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.196027:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.196037:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938073.196059:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008973fd28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095744:0@lo:101: 00000100:00100000:3.0:1784938073.196359:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938073.196443:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 000000003771d80b going to sleep for 11 seconds 00000100:00100000:1.0:1784938073.199398:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144095744 00000100:00100000:1.0:1784938073.199411:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144095744 00000100:00100000:3.0:1784938073.199512:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784938073.199521:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b77010d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+11:6490:x1871643144095744:12345-0@lo:101: 00010000:00010000:3.0:1784938073.199548:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938073.199566:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ede45 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.199609:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ede45 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.199618:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ede45 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.199628:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008bd53e14, rc 0) 00000100:00100000:3.0:1784938073.199700:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b77010d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6490:x1871643144095744:12345-0@lo:101: Request processed in 180us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938073.199706:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784938073.199849:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008973fd28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095744:0@lo:101: 00010000:00010000:1.0:1784938073.199873:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.199881:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938073.199945:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095872:0@lo:501: 00000100:00100000:1.0:1784938073.199978:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938073.200012:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 000000005f2967ac going to sleep for 11 seconds 00000100:00100000:0.0:1784938073.200068:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144095872 00000100:00100000:0.0:1784938073.200073:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144095872 00000100:00100000:0.0:1784938073.200105:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784938073.200111:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000428c1312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6490:x1871643144095872:12345-0@lo:501: 00000100:00100000:0.0:1784938073.200259:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000428c1312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6490:x1871643144095872:12345-0@lo:501: Request processed in 148us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938073.200265:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784938073.200421:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144095872:0@lo:501: 00000100:00100000:1.0:1784938073.200446:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144096000:0@lo:503: 00000100:00100000:1.0:1784938073.200483:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938073.200501:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 000000005f2967ac going to sleep for 11 seconds 00000100:00100000:0.0:1784938073.200638:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144096000 00000100:00100000:0.0:1784938073.200643:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144096000 00000100:00100000:0.0:1784938073.200670:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784938073.200684:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062131717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6490:x1871643144096000:12345-0@lo:503: 00000100:00100000:0.0:1784938073.200754:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062131717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6490:x1871643144096000:12345-0@lo:503: Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938073.200770:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784938073.201883:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144096000:0@lo:503: 00000100:00100000:1.0:1784938073.202810:0:6539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:6539:1871643144096128:0@lo:502: 00000100:00100000:1.0:1784938073.202870:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938073.202906:0:6539:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d92bb14f going to sleep for 11 seconds 00000100:00100000:0.0:1784938073.202942:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144096128 00000100:00100000:0.0:1784938073.202948:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144096128 00000100:00100000:0.0:1784938073.202988:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784938073.202995:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbe48463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6539:x1871643144096128:12345-0@lo:502: 00000100:00100000:0.0:1784938073.203106:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbe48463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6539:x1871643144096128:12345-0@lo:502: Request processed in 112us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938073.203311:0:6539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087a41489 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:6539:1871643144096128:0@lo:502: 00000020:01000004:3.0:1784938073.203359:0:6539:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784938073.203373:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004f48dcfa) 00000020:00000080:3.0:1784938073.203390:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1784938073.203534:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000094d6f938 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938073.203538:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000094d6f938 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938073.203540:0:6539:0:(obd_mount.c:706:lustre_put_lsi()) put 0000000094d6f938 4 00010000:00080000:3.0:1784938073.203568:0:6539:0:(ldlm_lib.c:125:import_set_conn()) imp 00000000da3ea083@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.126@tcp at head 00000100:00100000:0.0:1784938073.207702:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1784938073.211678:0:6539:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1784938073.211799:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784938073.211839:0:6539:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938073.211851:0:6539:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x26783cd1c59ede5a 00000100:00080000:3.0:1784938073.211862:0:6539:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:3.0:1784938073.211872:0:6539:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000da3ea083 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938073.211904:0:6539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006f46ea00 x1871643144096256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938073.212688:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f46ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144096256:192.168.203.126@tcp:38: 00000100:00100000:0.0:1784938073.217504:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00080000:3.0:1784938073.217601:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784938073.217840:0:6539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000093a7e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:6539:1871643144096384:0@lo:502: 00000100:00100000:3.0:1784938073.217900:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938073.217928:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144096384 00000100:00100000:3.0:1784938073.217934:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144096384 00000100:00100000:3.0:1784938073.217974:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784938073.217981:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000503b9f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6539:x1871643144096384:12345-0@lo:502: 00000100:00100000:3.0:1784938073.218077:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000503b9f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6539:x1871643144096384:12345-0@lo:502: Request processed in 96us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938073.218084:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784938073.218289:0:6539:0:(client.c:2702:ptlrpc_set_wait()) set 0000000021e8971a going to sleep for 11 seconds 00000100:00100000:3.0:1784938073.218310:0:6539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000093a7e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:6539:1871643144096384:0@lo:502: 00000040:00080000:3.0:1784938073.218330:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1784938073.218477:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1784938073.218494:0:6490:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938073.218505:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938073.218514:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784938073.218552:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784938073.218554:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938073.218555:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938073.218557:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938073.218558:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938073.218559:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938073.218560:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938073.218561:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938073.218562:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938073.218563:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938073.218564:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938073.218565:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938073.218568:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1784938073.218571:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938073.218572:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938073.218576:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938073.218577:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938073.218577:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938073.218578:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938073.218579:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938073.218580:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938073.218581:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938073.218582:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938073.218582:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938073.218583:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938073.218595:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784938073.218602:0:6490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000007ad5f09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144096512:0@lo:253: 00000100:00100000:0.0:1784938073.218633:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938073.218656:0:6490:0:(client.c:2702:ptlrpc_set_wait()) set 00000000763307e6 going to sleep for 11 seconds 00000100:00100000:0.0:1784938073.219318:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144096512 00000100:00100000:0.0:1784938073.219325:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144096512 00000100:00100000:0.0:1784938073.219361:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784938073.219369:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c3211e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6490:x1871643144096512:12345-0@lo:253: 20000000:01000000:0.0:1784938073.219392:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784938073.219405:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784938073.223147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144096256 00000100:00100000:2.0:1784938073.223162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144096256 00000100:00100000:2.0:1784938073.223201:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:2.0:1784938073.223207:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea2b006c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1871643144096256:12345-192.168.203.126@tcp:38: 00000100:00100000:2.0:1784938073.223304:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea2b006c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1871643144096256:12345-192.168.203.126@tcp:38: Request processed in 96us (5806us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784938073.223311:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:3.0:1784938073.225026:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938073.225035:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000da3ea083 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938073.225041:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.126@tcp failed (-11) 00000100:00100000:3.0:1784938073.225045:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f46ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144096256:192.168.203.126@tcp:38: 20000000:01000000:1.0:1784938073.235453:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938073.235479:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784938073.235617:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784938073.235622:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784938073.235641:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.235659:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ede29 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.235666:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.235715:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ede29 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.235743:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ede29 expref: 12 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938073.235758:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f46ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144096640:0@lo:104: 00000100:00100000:3.0:1784938073.235818:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938073.235881:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set 0000000029077bc9 going to sleep for 11 seconds 00000100:00100000:1.0:1784938073.236035:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c3211e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6490:x1871643144096512:12345-0@lo:253: Request processed in 16667us (17401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938073.236045:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784938073.236156:0:6490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000007ad5f09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:6490:1871643144096512:0@lo:253: 10000000:01000000:2.0:1784938073.236167:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784938073.236170:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938073.236171:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784938073.236172:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938073.236174:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938073.236175:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938073.236176:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938073.236177:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938073.236178:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784938073.236179:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938073.236181:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938073.236182:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938073.236183:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784938073.236194:0:6490:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784938073.236848:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144096640 00000100:00100000:0.0:1784938073.236856:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144096640 00000100:00100000:0.0:1784938073.236904:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938073.236912:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093a7e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6528:x1871643144096640:12345-0@lo:104: 00010000:00010000:0.0:1784938073.236929:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938073.236990:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938073.236995:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093a7e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6528:x1871643144096640:12345-0@lo:104: Request processed in 85us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938073.237001:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784938073.237052:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938073.237057:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.237065:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087295396 already unused, calling callback (0000000003bcf0ae) 10000000:00010000:3.0:1784938073.237068:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.237075:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938073.237082:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938073.237087:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938073.237136:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.237143:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938073.237158:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.237164:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000087295396/0x26783cd1c59ede29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.237190:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938073.237192:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938073.237194:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938073.237236:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f46ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144096640:0@lo:104: 00010000:00010000:3.0:1784938073.237251:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938073.238396:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938073.238420:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dd4da95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144096768:0@lo:103: 00000100:00100000:0.0:1784938073.238468:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938073.238603:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144096768 00000100:00100000:1.0:1784938073.238610:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144096768 00010000:00010000:1.0:1784938073.238630:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ede29 expref: 12 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938073.238674:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784938073.238681:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0f1139c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:3640:x1871643144096768:12345-0@lo:103: 00010000:00010000:1.0:1784938073.238694:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938073.238698:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ede29 expref: 12 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238708:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ede29 expref: 12 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238722:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001be03fee/0x26783cd1c59ede30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ede29 expref: 12 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238737:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238744:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938073.238758:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003135881s 00010000:00010000:1.0:1784938073.238762:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238767:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238773:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238778:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238791:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000083e2a3c9 already unused, calling callback (00000000d7b3c3e8) 00010000:00010000:1.0:1784938073.238795:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238801:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238816:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938073.238825:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938073.238859:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0f1139c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+11:3640:x1871643144096768:12345-0@lo:103: Request processed in 178us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938073.238865:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938073.238933:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dd4da95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144096768:0@lo:103: 00010000:00010000:3.0:1784938073.239108:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.239133:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938073.239139:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000083e2a3c9/0x26783cd1c59ede61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1784938073.246351:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1784938073.246525:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1784938073.246735:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1784938073.247324:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1784938073.247516:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1784938073.247669:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1784938073.252732:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1784938073.260830:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1784938073.261086:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1784938073.261535:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1784938073.261736:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1784938073.261916:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1784938073.275519:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1784938073.286167:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784938073.286500:0:6544:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784938073.286505:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1784938073.287040:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:1.0:1784938073.298263:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1784938073.304322:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784938073.304438:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938073.305501:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784938073.305564:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784938073.305568:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:3.0:1784938073.308013:0:6490:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784938073.308161:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784938073.308424:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938073.309406:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784938073.309945:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784938073.309974:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1784938073.310134:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784938073.310383:0:6490:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1784938073.310989:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1784938073.312556:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1784938073.312787:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1784938073.312929:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1784938073.313079:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1784938073.313259:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1784938073.313404:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1784938073.313539:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1784938073.313666:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1784938073.313791:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1784938073.313957:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1784938073.314095:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1784938073.314275:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1784938073.314417:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1784938073.314573:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1784938073.314727:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1784938073.315010:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1784938073.315188:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1784938073.315356:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1784938073.315504:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1784938073.315662:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1784938073.315800:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1784938073.315926:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1784938073.316060:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1784938073.325550:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1784938073.325946:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1784938073.326085:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1784938073.326370:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1784938073.326502:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1784938073.327042:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1784938073.327198:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1784938073.327379:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1784938073.327605:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1784938073.332026:0:6490:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784938073.332063:0:6490:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7d541c67988 00100000:10000000:1.0:1784938073.332082:0:6490:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1784938073.337553:0:6490:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784938073.337642:0:6490:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784938073.337676:0:6490:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1784938073.337833:0:6490:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1784938073.341335:0:6490:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938073.341551:0:6490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1784938073.701865:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938074.720718:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938075.743412:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938076.767553:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938077.792331:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938078.368757:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784938078.368768:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784938078.368771:0:38:0:(import.c:65:import_set_state_nolock()) 00000000da3ea083 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938078.368786:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000da3ea083 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938078.368819:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d8c0d299 x1871643144097024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938078.368939:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938078.368953:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d334a55f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144096896:0@lo:400: 00000100:00100000:0.0:1784938078.369025:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938078.369095:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8c0d299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144097024:192.168.203.126@tcp:38: 00000100:00100000:0.0:1784938078.369290:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144096896 00000100:00100000:0.0:1784938078.369299:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144096896 00000100:00100000:0.0:1784938078.369345:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784938078.369352:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+11:3643:x1871643144096896:12345-0@lo:400: 00000100:00100000:0.0:1784938078.369400:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+11:3643:x1871643144096896:12345-0@lo:400: Request processed in 49us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938078.369407:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784938078.369559:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938078.369679:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d334a55f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144096896:0@lo:400: 00000100:00100000:2.0:1784938078.369943:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144097024 00000100:00100000:2.0:1784938078.369948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144097024 00000100:00100000:2.0:1784938078.369981:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:2.0:1784938078.369986:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047f9e704 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1871643144097024:12345-192.168.203.126@tcp:38: 00010000:00080000:2.0:1784938078.370008:0:6514:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:2.0:1784938078.370041:0:6514:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x26783cd1c59ede68 00000004:00100000:2.0:1784938078.370076:0:6514:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938078.370248:0:6514:0:(import.c:65:import_set_state_nolock()) 00000000236e987d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938078.370297:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047f9e704 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871643144097024:12345-192.168.203.126@tcp:38: Request processed in 310us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938078.370304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00010000:00080000:2.0:1784938078.370443:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d8c0d299 x1871643144097024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938078.370457:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784938078.370463:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784938078.370467:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784938078.370469:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000da3ea083 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784938078.370474:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8c0d299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144097024:192.168.203.126@tcp:38: 00010000:00010000:2.0:1784938078.815528:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938079.239000:0:6790:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784938079.840300:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784938080.171171:0:6842:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938080.171620:0:6842:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1784938080.415307:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938080.415327:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cca3c9000 from 3 10000000:01000000:0.0:1784938080.415332:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938080.415390:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938080.415402:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938080.415412:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938080.415433:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d334a55f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144097152:0@lo:101: 00000100:00100000:0.0:1784938080.415503:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938080.415555:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000002712ab22 going to sleep for 11 seconds 00000100:00100000:1.0:1784938080.415616:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144097152 00000100:00100000:1.0:1784938080.415623:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144097152 00000100:00100000:1.0:1784938080.415676:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784938080.415684:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e138233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+11:6510:x1871643144097152:12345-0@lo:101: 00010000:00010000:1.0:1784938080.415696:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938080.415709:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ede6f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938080.415730:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ede6f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938080.415739:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ede6f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938080.415747:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008870fe3c, rc 0) 00000100:00100000:1.0:1784938080.415806:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e138233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6510:x1871643144097152:12345-0@lo:101: Request processed in 123us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938080.415812:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784938080.415885:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d334a55f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144097152:0@lo:101: 00010000:00010000:3.0:1784938080.415900:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938080.415910:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938080.415960:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f46ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144097280:0@lo:256: 00000100:00100000:3.0:1784938080.415997:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938080.416025:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f72d68ed going to sleep for 11 seconds 00000100:00100000:0.0:1784938080.416059:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144097280 00000100:00100000:0.0:1784938080.416077:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144097280 00000100:00100000:0.0:1784938080.416106:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938080.416112:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004daadd09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6510:x1871643144097280:12345-0@lo:256: 20000000:01000000:0.0:1784938080.416125:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784938080.416140:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784938080.416143:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1784938080.416258:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004daadd09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+12:6510:x1871643144097280:12345-0@lo:256: Request processed in 146us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938080.416265:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784938080.416363:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f46ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144097280:0@lo:256: 10000000:01000000:3.0:1784938080.416408:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938080.416414:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938080.416421:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938080.872541:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938081.887366:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938082.912160:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784938083.425425:0:6943:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938083.425840:0:6943:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784938083.489677:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000804488c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144097408:0@lo:400: 00000100:00100000:0.0:1784938083.489788:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938083.489886:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144097536:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938083.491312:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144097408 00000100:00100000:3.0:1784938083.491328:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144097408 00000100:00100000:3.0:1784938083.491408:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784938083.491419:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a939078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:3643:x1871643144097408:12345-0@lo:400: 00000100:00100000:3.0:1784938083.491518:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a939078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:3643:x1871643144097408:12345-0@lo:400: Request processed in 102us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938083.491526:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784938083.491588:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000804488c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144097408:0@lo:400: 00000100:00100000:1.0:1784938083.492115:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938083.493026:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144097536 00000100:00100000:3.0:1784938083.493996:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144097536 00000100:00100000:3.0:1784938083.494463:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:3.0:1784938083.494476:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa2d24c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144097536:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938083.494556:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa2d24c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144097536:12345-192.168.203.126@tcp:400: Request processed in 83us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938083.494563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00010000:00080000:0.0:1784938083.497292:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005f13fc0d x1871643144097536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938083.497318:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144097536:192.168.203.126@tcp:400: 00010000:00010000:2.0:1784938083.935772:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938084.960385:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938085.987435:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938087.011681:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938088.034374:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938088.609189:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a97f1e27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144097792:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938088.609402:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005668e8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144097664:0@lo:400: 00000100:00100000:0.0:1784938088.609453:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938088.609622:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938088.609646:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144097664 00000100:00100000:0.0:1784938088.609653:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144097664 00000100:00100000:0.0:1784938088.609692:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938088.609700:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054df6567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:3641:x1871643144097664:12345-0@lo:400: 00000100:00100000:0.0:1784938088.609745:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054df6567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:3641:x1871643144097664:12345-0@lo:400: Request processed in 46us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938088.609752:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938088.609790:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144097792 00000100:00100000:0.0:1784938088.609793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144097792 00000100:00100000:0.0:1784938088.609815:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:0.0:1784938088.609821:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b70d369 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144097792:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938088.609854:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b70d369 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144097792:12345-192.168.203.126@tcp:400: Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938088.609860:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:0.0:1784938088.609978:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005668e8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144097664:0@lo:400: 00010000:00080000:0.0:1784938088.610009:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a97f1e27 x1871643144097792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938088.610032:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a97f1e27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144097792:192.168.203.126@tcp:400: 00010000:00010000:3.0:1784938089.075188:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938090.086367:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938091.119347:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938092.127367:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938093.151673:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938093.727419:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f46ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144097920:0@lo:400: 00000100:00100000:3.0:1784938093.727571:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144098048:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938093.727875:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938093.728112:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938093.728185:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144097920 00000100:00100000:3.0:1784938093.728195:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144097920 00000100:00100000:3.0:1784938093.728734:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784938093.728745:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b1c7f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+12:3643:x1871643144097920:12345-0@lo:400: 00000100:00100000:3.0:1784938093.728831:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b1c7f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+12:3643:x1871643144097920:12345-0@lo:400: Request processed in 89us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938093.728839:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784938093.729133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144098048 00000100:00100000:3.0:1784938093.729139:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144098048 00000100:00100000:3.0:1784938093.729230:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:3.0:1784938093.729237:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fc40b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144098048:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938093.729290:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fc40b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144098048:12345-192.168.203.126@tcp:400: Request processed in 54us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938093.729298:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00010000:00080000:3.0:1784938093.729942:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ccb31679 x1871643144098048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938093.729987:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144098048:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938093.730038:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f46ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144097920:0@lo:400: 00010000:00010000:2.0:1784938094.175402:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784938094.661306:0:7442:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:2.0:1784938094.661312:0:7442:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1784938094.661313:0:7442:0:(obd_mount.c:925:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784938094.661479:0:7442:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d458aa7b 00000020:01000004:2.0:1784938094.661501:0:7442:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1784938094.661514:0:7442:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784938094.661531:0:7442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000271f17ec) 00000020:00000080:2.0:1784938094.661548:0:7442:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784938094.750824:0:7442:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1784938094.753337:0:7442:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1784938094.792721:0:7442:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784938094.794126:0:7442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1784938094.794146:0:7442:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784938094.794164:0:7442:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59ede84 00000020:01000004:3.0:1784938094.794174:0:7442:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1784938094.794241:0:7442:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784938094.794245:0:7442:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784938094.794254:0:7442:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1784938094.794293:0:7442:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1784938094.794299:0:7442:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1784938094.872091:0:7442:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784938094.872155:0:7442:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1784938094.872161:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784938094.872163:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784938094.872164:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938094.872166:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938094.872167:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938094.872169:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938094.872170:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938094.872176:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938094.872177:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938094.872179:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938094.872180:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784938094.872184:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1784938094.872186:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784938094.872188:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784938094.872189:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938094.872189:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938094.872190:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938094.872191:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938094.872192:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938094.872193:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938094.872194:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938094.872194:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938094.872195:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784938094.872256:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1784938094.872279:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b4bda49c pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144098176:0@lo:253: 00000100:00100000:2.0:1784938094.872710:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938094.872786:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000003db90f54 going to sleep for 11 seconds 00000100:00100000:3.0:1784938094.872875:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144098176 00000100:00100000:3.0:1784938094.872886:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144098176 00000100:00100000:3.0:1784938094.872956:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784938094.872981:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089ea1084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:7442:x1871643144098176:12345-0@lo:253: 20000000:01000000:3.0:1784938094.873024:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784938094.873031:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1784938094.873037:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1784938094.873041:0:6505:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1784938094.873097:0:6505:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1784938094.873527:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938094.873721:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1784938094.873739:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784938094.874850:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1784938094.874873:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1784938094.874888:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1784938094.877892:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1784938094.877929:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1784938094.878927:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1784938094.878951:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1784938094.879180:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1784938094.879189:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1784938094.879206:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1784938094.879532:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1784938094.880522:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1784938094.880561:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1784938094.880584:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1784938094.880592:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784938094.880612:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1784938094.880618:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1784938094.880631:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1784938094.880636:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1784938094.880648:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1784938094.880674:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1784938094.880688:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1784938094.881352:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1784938094.881370:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1784938094.881385:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1784938094.881402:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1784938094.881420:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1784938094.881483:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1784938094.881501:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1784938094.881857:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1784938094.881869:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1784938094.881912:0:6505:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1784938094.881922:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1784938094.891732:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1784938094.892115:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1784938094.892151:0:6505:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.126@tcp for mdt 20000000:01000000:2.0:1784938094.892155:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:2.0:1784938094.892171:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1784938094.892176:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784938094.892187:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1784938094.892194:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:2.0:1784938094.892208:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1784938094.892245:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1784938094.892260:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1784938094.892295:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1784938094.892353:0:6505:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1784938094.892363:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1784938094.893908:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1784938094.894211:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1784938094.894282:0:6505:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.203.126@tcp for mdt 20000000:01000000:3.0:1784938094.894285:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1784938094.894303:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1784938094.894309:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784938094.894321:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1784938094.894336:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1784938094.894350:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1784938094.894358:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1784938094.894370:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1784938094.894384:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1784938094.894412:0:6505:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784938094.894415:0:6505:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784938094.894421:0:6505:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784938094.894478:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784938094.894480:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784938094.894850:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1784938094.894873:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1784938094.894887:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1784938094.895068:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1784938094.895088:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1784938094.895123:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1784938094.895135:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784938094.895137:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784938094.895586:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1784938094.895608:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1784938094.895624:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1784938094.895780:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1784938094.895799:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1784938094.895812:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1784938094.895823:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1784938094.895825:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784938094.909591:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1784938094.909790:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1784938094.909826:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1784938094.910381:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1784938094.910414:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1784938094.910430:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1784938094.910452:0:6505:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784938094.910455:0:6505:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784938094.910461:0:6505:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1784938094.910469:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1784938094.911006:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1784938094.911371:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784938094.943920:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784938094.944189:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.944210:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59eddb9 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.944250:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59eddd5 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.944257:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ede45 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.944264:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.944309:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ede45 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.944325:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ede45 expref: 12 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938094.944337:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d0fa063d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144098304:0@lo:104: 00000100:00100000:2.0:1784938094.944406:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938094.944482:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59eddd5 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.944494:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59eddd5 expref: 12 pid: 6505 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938094.944521:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144098304 00000100:00100000:2.0:1784938094.944528:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c253716 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144098432:0@lo:104: 00000100:00100000:3.0:1784938094.944544:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144098304 00000100:00100000:2.0:1784938094.944559:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938094.944603:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144098432 00000100:00100000:3.0:1784938094.944608:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144098432 00000100:00100000:3.0:1784938094.944629:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938094.944638:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059b47545 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6505:x1871643144098304:12345-0@lo:104: 00010000:00010000:3.0:1784938094.944659:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.944946:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59eddb9 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.944956:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59eddb9 expref: 12 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938094.944964:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cf7c00c7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144098560:0@lo:104: 00010000:00010000:3.0:1784938094.945798:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938094.945812:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059b47545 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6505:x1871643144098304:12345-0@lo:104: Request processed in 1173us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938094.945825:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1784938094.945832:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938094.945853:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.945862:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f4f49204 already unused, calling callback (0000000003bcf0ae) 10000000:00010000:0.0:1784938094.945866:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.945875:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938094.945882:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938094.945886:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 10000000:01000000:0.0:1784938094.945896:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784938094.945903:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b0f9978 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6505:x1871643144098432:12345-0@lo:104: 00010000:00010000:3.0:1784938094.945919:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.945946:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.945955:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938094.945993:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1784938094.945997:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938094.946003:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b0f9978 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6505:x1871643144098432:12345-0@lo:104: Request processed in 104us (1443us total) trans 0 rc 0/0 00010000:00010000:0.0:1784938094.946025:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000f4f49204/0x26783cd1c59ede45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938094.946029:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1784938094.946054:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938094.946057:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.946065:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0b3a256 already unused, calling callback (0000000003bcf0ae) 10000000:00010000:0.0:1784938094.946068:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.946087:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938094.946092:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938094.946098:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938094.946112:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.946118:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938094.946143:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.946149:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000f0b3a256/0x26783cd1c59eddd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edddc expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.946160:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938094.946162:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938094.946163:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938094.946178:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144098688:0@lo:103: 00000100:00100000:0.0:1784938094.946262:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.946311:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938094.946318:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5b6764c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144098816:0@lo:103: 00000100:00100000:0.0:1784938094.946340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.946374:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144098688 00000100:00100000:0.0:1784938094.946380:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144098688 00010000:00010000:0.0:1784938094.946405:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ede45 expref: 13 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938094.946443:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144098816 00000100:00100000:0.0:1784938094.946447:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144098816 00010000:00010000:0.0:1784938094.946457:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59eddd5 expref: 14 pid: 6505 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938094.946470:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784938094.946476:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007328e967 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+14:3641:x1871643144098688:12345-0@lo:103: 00010000:00010000:0.0:1784938094.946487:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938094.946491:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ede45 expref: 14 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.946501:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ede45 expref: 14 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.946516:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938094.946546:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007328e967 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+14:3641:x1871643144098688:12345-0@lo:103: Request processed in 70us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.946554:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784938094.946570:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784938094.946575:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089139152 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+13:3643:x1871643144098816:12345-0@lo:103: 00010000:00010000:0.0:1784938094.946595:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938094.946599:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59eddd5 expref: 13 pid: 6505 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.946606:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59eddd5 expref: 13 pid: 6505 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.946616:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938094.946647:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089139152 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+13:3643:x1871643144098816:12345-0@lo:103: Request processed in 72us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.946653:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784938094.946692:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5b6764c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144098816:0@lo:103: 00000100:00100000:0.0:1784938094.946715:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144098688:0@lo:103: 00010000:00010000:2.0:1784938094.948557:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938094.949089:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938094.949185:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f1ee699 going to sleep for 11 seconds 00010000:00010000:2.0:1784938094.949260:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008bd53e14/0x26783cd1c59ede4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ede45 expref: 12 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938094.949275:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d0fa063d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144098304:0@lo:104: 00010000:00010000:2.0:1784938094.949287:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000801e4e69/0x26783cd1c59edddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59eddd5 expref: 11 pid: 6505 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938094.949295:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c253716 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144098432:0@lo:104: 00000100:00100000:1.0:1784938094.956399:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144098560 00000100:00100000:1.0:1784938094.956415:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144098560 00000100:00100000:2.0:1784938094.956567:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938094.956576:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d84aaa4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6505:x1871643144098560:12345-0@lo:104: 00010000:00010000:2.0:1784938094.956606:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.956706:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938094.956713:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d84aaa4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6505:x1871643144098560:12345-0@lo:104: Request processed in 137us (7628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938094.956736:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784938094.956768:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cf7c00c7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144098560:0@lo:104: 00010000:00010000:3.0:1784938094.956813:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.956855:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938094.956862:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.956870:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000649f3635 already unused, calling callback (0000000003bcf0ae) 10000000:00010000:1.0:1784938094.956874:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.956883:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938094.956901:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938094.956906:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938094.956948:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.956955:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938094.956996:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957003:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59eddb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59eddc0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957021:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938094.957024:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1784938094.957025:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938094.957030:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938094.957052:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad0d1cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144098944:0@lo:103: 00000100:00100000:3.0:1784938094.957140:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938094.957413:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144098944 00000100:00100000:1.0:1784938094.957420:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144098944 00010000:00010000:1.0:1784938094.957443:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59eddb9 expref: 11 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938094.957542:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938094.957549:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+11:3642:x1871643144098944:12345-0@lo:103: 00010000:00010000:1.0:1784938094.957561:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938094.957566:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59eddb9 expref: 11 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957577:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59eddb9 expref: 11 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957607:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f14dfe24/0x26783cd1c59eddc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59eddb9 expref: 11 pid: 6506 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957621:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957628:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957642:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957648:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957655:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957661:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957666:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee3ea0e1 already unused, calling callback (00000000d7b3c3e8) 00010000:00010000:1.0:1784938094.957670:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957676:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957694:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.957716:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938094.957732:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938094.957744:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938094.957751:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee3ea0e1/0x26783cd1c59ede8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938094.957781:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+10:3642:x1871643144098944:12345-0@lo:103: Request processed in 231us (639us total) trans 0 rc 0/0 20000000:01000000:3.0:1784938094.957784:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1784938094.957798:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784938094.957868:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad0d1cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144098944:0@lo:103: 00000100:00100000:2.0:1784938094.970566:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089ea1084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:7442:x1871643144098176:12345-0@lo:253: Request processed in 97579us (97850us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938094.970592:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938094.973474:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b4bda49c pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144098176:0@lo:253: 10000000:01000000:0.0:1784938094.973495:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1784938094.973499:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938094.973501:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784938094.973502:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938094.973503:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1784938094.973505:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938094.973506:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938094.973507:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938094.973508:0:7442:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784938094.973510:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938094.973511:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784938094.973539:0:7442:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d458aa7b from lustre-MDT0001 10000000:01000000:0.0:1784938094.973574:0:7442:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1784938094.973577:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1784938094.973688:0:7442:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910cf3bf8000 local copy 10000000:01000000:0.0:1784938094.973693:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784938094.973730:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.973742:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.973751:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938094.973787:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099072:0@lo:101: 00000100:00100000:0.0:1784938094.973852:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.973895:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c9ed32d going to sleep for 11 seconds 00000100:00100000:3.0:1784938094.974043:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144099072 00000100:00100000:3.0:1784938094.974063:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144099072 00000100:00100000:3.0:1784938094.974348:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784938094.974361:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b420a59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+9:7442:x1871643144099072:12345-0@lo:101: 00010000:00010000:3.0:1784938094.974398:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938094.974422:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eebbca3f/0x26783cd1c59ede99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ede92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938094.974476:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eebbca3f/0x26783cd1c59ede99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ede92 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938094.974490:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eebbca3f/0x26783cd1c59ede99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ede92 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938094.974501:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eebbca3f, rc 0) 00000100:00100000:3.0:1784938094.974589:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b420a59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+10:7442:x1871643144099072:12345-0@lo:101: Request processed in 232us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.974640:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099072:0@lo:101: 00010000:00010000:0.0:1784938094.974657:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.974668:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938094.974766:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099200:0@lo:501: 00000100:00100000:0.0:1784938094.974804:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.974834:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c9ed32d going to sleep for 11 seconds 00000100:00100000:2.0:1784938094.974952:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144099200 00000100:00100000:2.0:1784938094.974958:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144099200 00000100:00100000:3.0:1784938094.975024:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784938094.976041:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784938094.976057:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5faa8ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+10:7442:x1871643144099200:12345-0@lo:501: 00000100:00100000:2.0:1784938094.976262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5faa8ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+10:7442:x1871643144099200:12345-0@lo:501: Request processed in 209us (1456us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938094.976270:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938094.976668:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099200:0@lo:501: 10000000:01000000:0.0:1784938094.976691:0:7442:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784938094.976716:0:7442:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784938094.976723:0:7442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.976733:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.976739:0:7442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.976799:0:7442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784938094.976838:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910cc481d800 10000000:01000000:0.0:1784938094.976843:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784938094.976847:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff910cf3bf8000 10000000:01000000:0.0:1784938094.976850:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1784938094.976852:0:7442:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff910cf3bf8000 from 1 10000000:01000000:0.0:1784938094.976855:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784938094.976882:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000502cb875/0x26783cd1c59edea0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.976889:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000502cb875/0x26783cd1c59edea0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.976896:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000502cb875/0x26783cd1c59edea0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938094.976912:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099328:0@lo:101: 00000100:00100000:0.0:1784938094.976948:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.976993:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fee2e9b going to sleep for 11 seconds 00000100:00100000:1.0:1784938094.977052:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144099328 00000100:00100000:1.0:1784938094.977058:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144099328 00000100:00100000:1.0:1784938094.977099:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784938094.977106:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b6bb252 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+10:7442:x1871643144099328:12345-0@lo:101: 00010000:00010000:1.0:1784938094.977115:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938094.977128:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c53aab66/0x26783cd1c59edea7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edea0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.977147:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c53aab66/0x26783cd1c59edea7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edea0 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.977156:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c53aab66/0x26783cd1c59edea7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edea0 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938094.977163:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c53aab66, rc 0) 00000100:00100000:1.0:1784938094.977194:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b6bb252 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+11:7442:x1871643144099328:12345-0@lo:101: Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938094.977200:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938094.977466:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099328:0@lo:101: 00010000:00010000:0.0:1784938094.977480:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000502cb875/0x26783cd1c59edea0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977488:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000502cb875/0x26783cd1c59edea0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938094.977504:0:7442:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784938094.977523:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000502cb875/0x26783cd1c59edea0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977529:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000502cb875/0x26783cd1c59edea0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938094.977545:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff910cc481d800 10000000:01000000:0.0:1784938094.977548:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784938094.977551:0:7442:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff910cc481d800 from 1 10000000:01000000:0.0:1784938094.977552:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784938094.977565:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000009adbd9f2/0x26783cd1c59edeae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977571:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000009adbd9f2/0x26783cd1c59edeae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977577:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000009adbd9f2/0x26783cd1c59edeae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938094.977599:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099456:0@lo:101: 00000100:00100000:0.0:1784938094.977627:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.977644:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fee2e9b going to sleep for 11 seconds 00000100:00100000:0.0:1784938094.977658:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144099456 00000100:00100000:0.0:1784938094.977661:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144099456 00000100:00100000:0.0:1784938094.977681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938094.977687:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5cb3de6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+11:7442:x1871643144099456:12345-0@lo:101: 00010000:00010000:0.0:1784938094.977693:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938094.977701:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000801e4e69/0x26783cd1c59edeb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edeae expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977714:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000801e4e69/0x26783cd1c59edeb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edeae expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977721:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000801e4e69/0x26783cd1c59edeb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edeae expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977733:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000801e4e69, rc 0) 00000100:00100000:0.0:1784938094.977765:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5cb3de6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:7442:x1871643144099456:12345-0@lo:101: Request processed in 78us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.977771:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938094.977796:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099456:0@lo:101: 00010000:00010000:0.0:1784938094.977806:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000009adbd9f2/0x26783cd1c59edeae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977812:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000009adbd9f2/0x26783cd1c59edeae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938094.977821:0:7442:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784938094.977824:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 000000009adbd9f2/0x26783cd1c59edeae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977829:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 000000009adbd9f2/0x26783cd1c59edeae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938094.977835:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1784938094.977838:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938094.977841:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff910cc481d800 10000000:01000000:0.0:1784938094.977843:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784938094.977846:0:7442:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1784938094.977848:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784938094.977858:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59edebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977864:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59edebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977876:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59edebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938094.977890:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099584:0@lo:101: 00000100:00100000:0.0:1784938094.977913:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.977920:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fee2e9b going to sleep for 11 seconds 00000100:00100000:0.0:1784938094.977938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144099584 00000100:00100000:0.0:1784938094.977942:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144099584 00000100:00100000:0.0:1784938094.977956:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938094.977961:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000223647ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+12:7442:x1871643144099584:12345-0@lo:101: 00010000:00010000:0.0:1784938094.977967:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938094.977988:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000446cb49c/0x26783cd1c59edec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edebc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.977999:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000446cb49c/0x26783cd1c59edec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edebc expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.978007:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000446cb49c/0x26783cd1c59edec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edebc expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.978013:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000446cb49c, rc 0) 00000100:00100000:0.0:1784938094.978040:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000223647ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+13:7442:x1871643144099584:12345-0@lo:101: Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.978045:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938094.978068:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099584:0@lo:101: 00010000:00010000:0.0:1784938094.978077:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59edebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938094.978093:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59edebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938094.978158:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099712:0@lo:501: 00000100:00100000:0.0:1784938094.978183:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.978193:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fee2e9b going to sleep for 11 seconds 00000100:00100000:0.0:1784938094.978210:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144099712 00000100:00100000:0.0:1784938094.978498:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144099712 00000100:00100000:0.0:1784938094.978519:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784938094.978524:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061461daf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+13:7442:x1871643144099712:12345-0@lo:501: 00000100:00100000:0.0:1784938094.978675:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061461daf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+13:7442:x1871643144099712:12345-0@lo:501: Request processed in 151us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.978683:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784938094.978710:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099712:0@lo:501: 00000100:00100000:0.0:1784938094.978736:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099840:0@lo:503: 00000100:00100000:0.0:1784938094.978780:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.978795:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fee2e9b going to sleep for 11 seconds 00000100:00100000:0.0:1784938094.978812:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144099840 00000100:00100000:0.0:1784938094.978816:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144099840 00000100:00100000:0.0:1784938094.978832:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784938094.978837:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0c5b89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+13:7442:x1871643144099840:12345-0@lo:503: 00000100:00100000:0.0:1784938094.978914:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0c5b89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+13:7442:x1871643144099840:12345-0@lo:503: Request processed in 77us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.978920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784938094.978952:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099840:0@lo:503: 00000040:00080000:0.0:1784938094.979195:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784938094.979779:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099968:0@lo:502: 00000100:00100000:0.0:1784938094.979828:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938094.979892:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fee2e9b going to sleep for 11 seconds 00010000:00010000:2.0:1784938094.979956:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938094.979963:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.979985:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f59a56ed already unused, calling callback (0000000003bcf0ae) 10000000:00010000:2.0:1784938094.979989:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.979998:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938094.980006:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938094.980012:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938094.980031:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.980048:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938094.980075:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.980081:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59ede92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26783cd1c59ede99 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.980094:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938094.980096:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938094.980097:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938094.980105:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938094.980116:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073a2a81f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144100096:0@lo:103: 00000100:00100000:2.0:1784938094.982953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938094.983029:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144100096 00000100:00100000:2.0:1784938094.983037:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144100096 00000100:00100000:2.0:1784938094.983093:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938094.983101:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007863f6a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+13:3641:x1871643144100096:12345-0@lo:103: 00010000:00010000:2.0:1784938094.983114:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938094.983129:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eebbca3f/0x26783cd1c59ede99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ede92 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938094.983146:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938094.983178:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007863f6a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+12:3641:x1871643144100096:12345-0@lo:103: Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938094.983186:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938094.988953:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073a2a81f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144100096:0@lo:103: 00000100:00100000:1.0:1784938094.993856:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144099968 00000100:00100000:1.0:1784938094.993870:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144099968 00000100:00100000:0.0:1784938094.994172:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784938094.994181:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001647c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:7442:x1871643144099968:12345-0@lo:502: 00000100:00100000:0.0:1784938094.994396:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001647c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:7442:x1871643144099968:12345-0@lo:502: Request processed in 215us (14568us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.994405:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784938094.994655:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006319c79e pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144099968:0@lo:502: 00000040:00080000:2.0:1784938094.994907:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784938094.994940:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1784938094.994955:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1784938094.994977:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1784938094.994994:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1784938094.995006:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1784938094.995018:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1784938094.995031:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1784938094.995043:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1784938094.995055:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1784938094.995068:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1784938094.995081:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1784938094.995094:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1784938094.995107:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1784938094.995121:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1784938094.995136:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1784938094.995150:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1784938094.995162:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1784938094.995175:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1784938094.995189:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1784938094.995203:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1784938094.995239:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1784938094.995256:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1784938094.995288:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073a2a81f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100224:0@lo:502: 00000100:00100000:2.0:1784938094.995343:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938094.995373:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a96d1a0c going to sleep for 11 seconds 00000100:00100000:0.0:1784938094.995527:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144100224 00000100:00100000:0.0:1784938094.995533:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144100224 00000100:00100000:0.0:1784938094.995560:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784938094.995566:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccce43ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:7442:x1871643144100224:12345-0@lo:502: 00000100:00100000:0.0:1784938094.995671:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccce43ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:7442:x1871643144100224:12345-0@lo:502: Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.995678:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938094.997557:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073a2a81f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100224:0@lo:502: 00000040:00080000:2.0:1784938094.997680:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1784938094.997694:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1784938094.998927:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938094.998943:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938094.998946:0:7454:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784938094.998953:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1784938094.998958:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938094.999002:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000015f82aa9) 00000020:00000080:0.0:1784938094.999024:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1784938094.999033:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784938094.999121:0:7454:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784938094.999129:0:7454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59eded1 00000020:00000080:0.0:1784938094.999392:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784938094.999397:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938094.999406:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938094.999407:0:7454:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784938094.999410:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938094.999414:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938094.999415:0:7454:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1784938094.999418:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938094.999427:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000035e89643) 00000020:00000080:0.0:1784938094.999438:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1784938094.999441:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784938094.999443:0:7454:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1784938094.999445:0:7454:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1784938094.999451:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784938094.999513:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d458aa7b from lustre-MDT0001, refs=2 00000020:00000080:0.0:1784938094.999527:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000f624aedb) 00000020:00000080:0.0:1784938094.999535:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1784938095.000207:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784938095.000389:0:7454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59edee6 00000020:00000080:0.0:1784938095.000511:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1784938095.000518:0:7454:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784938095.000523:0:7454:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x26783cd1c59edeed 00080000:01000000:0.0:1784938095.000529:0:7454:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784938095.000533:0:7454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59edef4 00080000:10000000:0.0:1784938095.002099:0:7454:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1784938095.004573:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1784938095.170820:0:7454:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1784938095.172124:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1784938095.176904:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1784938095.177686:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:1.0:1784938095.199425:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784938095.201991:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1784938095.202006:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938095.202012:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938095.202015:0:7454:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1784938095.202018:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938095.202023:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938095.202025:0:7454:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1784938095.202028:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784938095.202032:0:7454:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:2.0:1784938095.202057:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938095.202080:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000009c1d2ca) 00000020:00000080:2.0:1784938095.202102:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1784938095.202109:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784938095.202194:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1784938095.202200:0:7454:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784938095.202207:0:7454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59edf02 00010000:00080000:2.0:1784938095.202285:0:7454:0:(ldlm_lib.c:125:import_set_conn()) imp 00000000d9fe6a1b@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1784938095.214186:0:7454:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1784938095.226481:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784938095.226503:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784938095.226553:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784938095.226590:0:7454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59edf09 00000100:00080000:1.0:1784938095.226606:0:7454:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:1.0:1784938095.226621:0:7454:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000d9fe6a1b using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:1.0:1784938095.226811:0:7454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000917812a8 x1871643144100352/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.203.126@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938095.226851:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1784938095.226920:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938095.226926:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938095.226927:0:7454:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1784938095.226930:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784938095.226933:0:7454:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1784938095.226936:0:7454:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938095.226937:0:7454:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938095.226938:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784938095.226941:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938095.226942:0:7454:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784938095.226945:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938095.226949:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938095.226951:0:7454:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1784938095.226955:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784938095.227189:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938095.227210:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144100480:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938095.227569:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938095.227602:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144100480 00000100:00100000:3.0:1784938095.227610:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144100480 00000004:01000000:1.0:1784938095.227939:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1784938095.228150:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938095.228160:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004019d3c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144100480:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938095.228254:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004019d3c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144100480:12345-192.168.203.126@tcp:400: Request processed in 94us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938095.228262:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00010000:00080000:3.0:1784938095.228447:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ccb31679 x1871643144100480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938095.228465:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144100480:192.168.203.126@tcp:400: 00000020:01000000:1.0:1784938095.228573:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938095.228588:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938095.228591:0:7454:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1784938095.228596:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938095.228600:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938095.228601:0:7454:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784938095.228604:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784938095.228606:0:7454:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784938095.229055:0:7454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938095.229062:0:7454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938095.229064:0:7454:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784938095.229147:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1784938095.229416:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1784938095.229464:0:7442:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784938095.229488:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59edebc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.229502:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000649f3635/0x26783cd1c59edebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938095.229511:0:7442:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cc481d800 from 1 10000000:01000000:3.0:1784938095.229515:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784938095.229555:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.229562:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.229573:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938095.229599:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100608:0@lo:101: 00000100:00100000:2.0:1784938095.229682:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000917812a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144100352:192.168.203.126@tcp:38: 00000100:00100000:3.0:1784938095.234333:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938095.234380:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007e727a89 going to sleep for 11 seconds 00000100:00100000:0.0:1784938095.234488:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144100608 00000100:00100000:0.0:1784938095.234499:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144100608 00000100:00100000:0.0:1784938095.234565:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784938095.234575:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb554c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+12:7442:x1871643144100608:12345-0@lo:101: 00010000:00010000:0.0:1784938095.234598:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938095.234637:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edf10 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.234704:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edf10 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.234719:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf10 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.234730:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000365aee0b, rc 0) 00000100:00100000:1.0:1784938095.234799:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938095.234806:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb554c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+13:7442:x1871643144100608:12345-0@lo:101: Request processed in 227us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938095.234818:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784938095.234963:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144100352 00000100:00100000:2.0:1784938095.234981:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144100352 00000100:00100000:2.0:1784938095.235020:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:2.0:1784938095.235026:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f387dff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1871643144100352:12345-192.168.203.126@tcp:38: 00010000:00080000:2.0:1784938095.235052:0:6517:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:2.0:1784938095.235081:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59edf1e 00000004:00100000:2.0:1784938095.235092:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1784938095.235112:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1784938095.235202:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100608:0@lo:101: 00010000:00010000:3.0:1784938095.235252:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.235263:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938095.236196:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100736:0@lo:256: 00000100:00100000:3.0:1784938095.238171:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938095.238330:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007e727a89 going to sleep for 11 seconds 00000100:00100000:0.0:1784938095.239164:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144100736 00000100:00100000:0.0:1784938095.239180:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144100736 00000100:00100000:0.0:1784938095.239368:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784938095.239379:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086030670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+13:7442:x1871643144100736:12345-0@lo:256: 20000000:01000000:0.0:1784938095.239415:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784938095.239445:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784938095.239449:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1784938095.239596:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086030670 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+13:7442:x1871643144100736:12345-0@lo:256: Request processed in 218us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938095.239604:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784938095.239885:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100736:0@lo:256: 10000000:01000000:3.0:1784938095.240563:0:7442:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938095.240588:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.240601:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938095.240610:0:7442:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cc481d800 from 1 10000000:01000000:3.0:1784938095.240613:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938095.240666:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.240675:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.240685:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938095.240706:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100864:0@lo:101: 00000100:00100000:3.0:1784938095.240763:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938095.241300:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007e727a89 going to sleep for 11 seconds 00000100:00100000:2.0:1784938095.244568:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144100864 00000100:00100000:2.0:1784938095.244591:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144100864 00000100:00100000:2.0:1784938095.244686:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784938095.244696:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1f6f622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+13:7442:x1871643144100864:12345-0@lo:101: 00010000:00010000:2.0:1784938095.244719:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938095.244744:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edf25 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.244779:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edf25 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.244792:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf25 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.244803:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e7017916, rc 0) 00000100:00100000:2.0:1784938095.245409:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1f6f622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:7442:x1871643144100864:12345-0@lo:101: Request processed in 712us (4643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.245420:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784938095.246144:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100864:0@lo:101: 00010000:00010000:3.0:1784938095.246174:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.246209:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938095.246380:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100992:0@lo:501: 00000100:00100000:3.0:1784938095.246444:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938095.246487:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007e727a89 going to sleep for 11 seconds 00000100:00100000:2.0:1784938095.247335:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144100992 00000100:00100000:2.0:1784938095.247347:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144100992 00000100:00100000:2.0:1784938095.247396:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784938095.247405:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a616fb8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:7442:x1871643144100992:12345-0@lo:501: 00000100:00100000:2.0:1784938095.247575:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a616fb8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:7442:x1871643144100992:12345-0@lo:501: Request processed in 170us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.247583:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784938095.248087:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144100992:0@lo:501: 00000100:00100000:3.0:1784938095.248145:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101120:0@lo:503: 00000100:00100000:3.0:1784938095.248207:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938095.248268:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 000000007e727a89 going to sleep for 11 seconds 00000100:00100000:1.0:1784938095.248408:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144101120 00000100:00100000:1.0:1784938095.248422:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144101120 00000100:00100000:1.0:1784938095.248498:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938095.248507:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb36d92b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+14:7442:x1871643144101120:12345-0@lo:503: 00000040:00080000:1.0:1784938095.248569:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938095.248737:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb36d92b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+14:7442:x1871643144101120:12345-0@lo:503: Request processed in 231us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938095.248745:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938095.248825:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ccb31679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101120:0@lo:503: 00000040:00080000:1.0:1784938095.249901:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938095.249965:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1784938095.250060:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1784938095.251869:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000172287a3 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938095.252090:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f387dff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1871643144100352:12345-192.168.203.126@tcp:38: Request processed in 17060us (17299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.252111:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:2.0:1784938095.252664:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938095.252676:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1784938095.252687:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784938095.252693:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784938095.252696:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000d9fe6a1b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784938095.252722:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000917812a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144100352:192.168.203.126@tcp:38: 00000100:00100000:2.0:1784938095.253004:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fb459dbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144101248:192.168.203.126@tcp:41: 00000100:00100000:3.0:1784938095.253350:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938095.253401:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144101248 00000100:00100000:3.0:1784938095.253409:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144101248 00000100:00100000:3.0:1784938095.253471:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:3.0:1784938095.253480:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efb1563a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144101248:12345-192.168.203.126@tcp:41: 00000004:00000024:3.0:1784938095.253517:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1784938095.253563:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efb1563a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144101248:12345-192.168.203.126@tcp:41: Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938095.253570:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:2.0:1784938095.254262:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fb459dbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144101248:192.168.203.126@tcp:41: 00000040:00080000:2.0:1784938095.258936:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1784938095.259477:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1784938095.259516:0:7442:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938095.259538:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938095.259550:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938095.259605:0:7442:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784938095.259608:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910cc481d800 10000000:01000000:1.0:1784938095.259611:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910cc481d800 10000000:01000000:1.0:1784938095.259614:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938095.259620:0:7442:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cc481d800 from 1 10000000:01000000:1.0:1784938095.259622:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938095.259726:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000980b1d7f/0x26783cd1c59edf33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938095.259744:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000980b1d7f/0x26783cd1c59edf33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938095.259755:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000980b1d7f/0x26783cd1c59edf33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938095.259778:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101376:0@lo:101: 00000100:00100000:1.0:1784938095.259844:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938095.259923:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bfe13876 going to sleep for 11 seconds 00000100:00100000:2.0:1784938095.259983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144101376 00000100:00100000:2.0:1784938095.259990:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144101376 00000100:00100000:2.0:1784938095.260290:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784938095.260298:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c68fb984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+14:7442:x1871643144101376:12345-0@lo:101: 00010000:00010000:2.0:1784938095.260312:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938095.260324:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c2cd8d1/0x26783cd1c59edf3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edf33 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.260413:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c2cd8d1/0x26783cd1c59edf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edf33 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.260425:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c2cd8d1/0x26783cd1c59edf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf33 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.260433:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c2cd8d1, rc 0) 00000100:00100000:2.0:1784938095.260534:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c68fb984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144101376:12345-0@lo:101: Request processed in 233us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.260550:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938095.260616:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101376:0@lo:101: 00010000:00010000:1.0:1784938095.260631:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000980b1d7f/0x26783cd1c59edf33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938095.260640:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000980b1d7f/0x26783cd1c59edf33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938095.260816:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101504:0@lo:501: 00000100:00100000:1.0:1784938095.260846:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938095.260911:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bfe13876 going to sleep for 11 seconds 00000100:00100000:2.0:1784938095.260957:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144101504 00000100:00100000:2.0:1784938095.260962:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144101504 00000100:00100000:2.0:1784938095.261004:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784938095.261011:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088763709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144101504:12345-0@lo:501: 00000100:00100000:2.0:1784938095.261157:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088763709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144101504:12345-0@lo:501: Request processed in 147us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.261164:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784938095.261211:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101504:0@lo:501: 00000100:00100000:1.0:1784938095.261427:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101632:0@lo:503: 00000100:00100000:1.0:1784938095.261469:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938095.261526:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bfe13876 going to sleep for 11 seconds 00000100:00100000:2.0:1784938095.261559:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144101632 00000100:00100000:2.0:1784938095.261564:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144101632 00000100:00100000:2.0:1784938095.261592:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784938095.261598:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6f77aef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144101632:12345-0@lo:503: 00000100:00100000:2.0:1784938095.261803:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6f77aef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144101632:12345-0@lo:503: Request processed in 204us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.261810:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784938095.261879:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101632:0@lo:503: 00000040:00080000:1.0:1784938095.262312:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938095.262455:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101760:0@lo:502: 00000100:00100000:1.0:1784938095.262497:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938095.262550:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 00000000594dce4c going to sleep for 11 seconds 00000100:00100000:2.0:1784938095.262593:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144101760 00000100:00100000:2.0:1784938095.262598:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144101760 00000100:00100000:2.0:1784938095.262631:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938095.262636:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7117497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144101760:12345-0@lo:502: 00000100:00100000:2.0:1784938095.262844:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7117497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144101760:12345-0@lo:502: Request processed in 207us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.262852:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784938095.262913:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101760:0@lo:502: 00000040:00080000:1.0:1784938095.263111:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784938095.263134:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784938095.263148:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784938095.263160:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784938095.263173:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784938095.263184:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784938095.263195:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784938095.263207:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784938095.263444:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784938095.263461:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784938095.263474:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784938095.263487:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784938095.263499:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784938095.263511:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784938095.263523:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784938095.263536:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784938095.263548:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784938095.263573:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784938095.263589:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784938095.263602:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784938095.263613:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784938095.263624:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784938095.263635:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784938095.265723:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784938095.265794:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1784938095.265813:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1784938095.265828:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1784938095.265861:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1784938095.265909:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101888:0@lo:502: 00000100:00100000:1.0:1784938095.266002:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938095.266048:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bfe13876 going to sleep for 11 seconds 00000100:00100000:2.0:1784938095.266275:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144101888 00000100:00100000:2.0:1784938095.266283:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144101888 00000100:00100000:2.0:1784938095.266330:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784938095.266339:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af484e63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144101888:12345-0@lo:502: 00000100:00100000:2.0:1784938095.266482:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af484e63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144101888:12345-0@lo:502: Request processed in 144us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.266490:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784938095.266693:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144101888:0@lo:502: 00000040:00080000:1.0:1784938095.266747:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1784938095.266755:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1784938095.267516:0:7460:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1784938095.267545:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000006d300e4b) 00000020:00000080:1.0:1784938095.267567:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1784938095.267808:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d458aa7b from lustre-MDT0001, refs=3 00000020:01000004:1.0:1784938095.267812:0:7460:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d458aa7b from lustre-MDT0001, refs=3 00000020:01000004:1.0:1784938095.267814:0:7460:0:(obd_mount.c:706:lustre_put_lsi()) put 00000000d458aa7b 3 00010000:00080000:1.0:1784938095.267844:0:7460:0:(ldlm_lib.c:125:import_set_conn()) imp 000000002e9c3209@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1784938095.277912:0:7460:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1784938095.278034:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1784938095.278087:0:7460:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784938095.278101:0:7460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x26783cd1c59edf48 00000100:00080000:1.0:1784938095.278114:0:7460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:1.0:1784938095.278126:0:7460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000002e9c3209 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:1.0:1784938095.278160:0:7460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cad29905 x1871643144102016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938095.278206:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871643144102016:192.168.203.126@tcp:38: 00000100:00100000:1.0:1784938095.278480:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938095.278514:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144102016 00000100:00100000:1.0:1784938095.278521:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144102016 00000100:00100000:1.0:1784938095.278549:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:1.0:1784938095.278555:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a7096f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1871643144102016:12345-192.168.203.126@tcp:38: 00010000:00080000:1.0:1784938095.278587:0:6514:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:1.0:1784938095.278626:0:6514:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x26783cd1c59edf4f 00000004:00100000:1.0:1784938095.278637:0:6514:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784938095.278667:0:6514:0:(import.c:65:import_set_state_nolock()) 00000000abe77cb5 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938095.278713:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a7096f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871643144102016:12345-192.168.203.126@tcp:38: Request processed in 156us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938095.278721:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00010000:00080000:0.0:1784938095.281402:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cad29905 x1871643144102016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938095.281419:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938095.281427:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784938095.281434:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784938095.281440:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784938095.281442:0:3639:0:(import.c:65:import_set_state_nolock()) 000000002e9c3209 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784938095.281457:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cad29905 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871643144102016:192.168.203.126@tcp:38: 00000100:00080000:0.0:1784938095.281649:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1784938095.289485:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1784938095.289785:0:7462:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1784938095.289920:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1784938095.289947:0:7442:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938095.289974:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000980b1d7f/0x26783cd1c59edf33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.289986:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000980b1d7f/0x26783cd1c59edf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784938095.290040:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784938095.290042:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784938095.290043:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938095.290044:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938095.290045:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938095.290046:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938095.290047:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938095.290049:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938095.290049:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938095.290050:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938095.290051:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938095.290054:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1784938095.290056:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938095.290057:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784938095.290057:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938095.290058:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938095.290059:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938095.290059:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938095.290060:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938095.290061:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938095.290061:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938095.290062:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938095.290063:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938095.290086:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1784938095.290101:0:7442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000093b0ddf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144102144:0@lo:253: 00000100:00100000:3.0:1784938095.290155:0:7442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938095.290194:0:7442:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cfea4871 going to sleep for 11 seconds 00000100:00100000:0.0:1784938095.290196:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144102144 00000100:00100000:0.0:1784938095.290789:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144102144 00000100:00100000:0.0:1784938095.290871:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784938095.290880:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d26c1cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144102144:12345-0@lo:253: 20000000:01000000:0.0:1784938095.290909:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784938095.290924:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1784938095.299361:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1784938095.299614:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938095.299634:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1784938095.299857:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784938095.299862:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784938095.299882:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.299901:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ede6f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.299924:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf10 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.299931:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.299983:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edf10 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.299996:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edf10 expref: 15 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938095.300011:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003425779e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144102272:0@lo:104: 00000100:00100000:3.0:1784938095.300071:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784938095.300119:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ede6f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.300127:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ede6f expref: 15 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938095.300135:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000015dcc2a9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144102400:0@lo:104: 00000100:00100000:3.0:1784938095.300156:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938095.300181:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set 000000009755ddb0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938095.300253:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144102272 00000100:00100000:0.0:1784938095.300268:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144102272 00000100:00100000:0.0:1784938095.300321:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144102400 00000100:00100000:0.0:1784938095.300324:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144102400 00000100:00100000:0.0:1784938095.300342:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938095.300351:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c80ec8bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6528:x1871643144102272:12345-0@lo:104: 00010000:00010000:0.0:1784938095.300371:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.300499:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938095.300506:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c80ec8bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6528:x1871643144102272:12345-0@lo:104: Request processed in 156us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938095.300517:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784938095.300590:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d26c1cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7442:x1871643144102144:12345-0@lo:253: Request processed in 9700us (10422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938095.300601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784938095.300616:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784938095.300626:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002490a6d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6528:x1871643144102400:12345-0@lo:104: 00010000:00010000:0.0:1784938095.300635:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938095.300676:0:7442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000093b0ddf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:7442:1871643144102144:0@lo:253: 10000000:01000000:1.0:1784938095.300690:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1784938095.300693:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938095.300696:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784938095.300698:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938095.300700:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938095.300703:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938095.300705:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938095.300707:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938095.300709:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784938095.300710:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784938095.300712:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938095.300714:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1784938095.300728:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000020:02000000:1.0:1784938095.300735:0:7442:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784938095.300739:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002490a6d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6528:x1871643144102400:12345-0@lo:104: Request processed in 112us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938095.300754:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784938095.301684:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003425779e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144102272:0@lo:104: 00000100:00100000:3.0:1784938095.301698:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000015dcc2a9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144102400:0@lo:104: 00010000:00010000:3.0:1784938095.301717:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.303046:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938095.303062:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.303076:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f8db03d7 already unused, calling callback (0000000003bcf0ae) 10000000:00010000:2.0:1784938095.303080:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.303091:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.303287:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1784938095.303656:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938095.303662:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938095.303726:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.303733:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784938095.303815:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073a2a81f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144102528:0@lo:103: 00000100:00100000:0.0:1784938095.303911:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938095.304170:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.304199:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000f8db03d7/0x26783cd1c59edf10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf17 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.304256:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938095.304258:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938095.304273:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938095.304424:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144102528 00000100:00100000:3.0:1784938095.304441:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144102528 00010000:00010000:3.0:1784938095.304480:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf10 expref: 15 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938095.304527:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784938095.304536:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b6764c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:3643:x1871643144102528:12345-0@lo:103: 00010000:00010000:3.0:1784938095.304550:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938095.304556:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf10 expref: 15 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.304567:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edf10 expref: 15 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.305710:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000365aee0b/0x26783cd1c59edf17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edf10 expref: 15 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.305742:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938095.305836:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b6764c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+14:3643:x1871643144102528:12345-0@lo:103: Request processed in 1301us (1925us total) trans 0 rc 0/0 00010000:00010000:0.0:1784938095.305847:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938095.305848:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1784938095.305867:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.305880:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efd4f29b already unused, calling callback (0000000003bcf0ae) 10000000:00010000:0.0:1784938095.305885:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.305896:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938095.305903:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938095.305909:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1784938095.305911:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073a2a81f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144102528:0@lo:103: 00010000:00010000:0.0:1784938095.306326:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.306336:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784938095.307149:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018740c38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144102656:0@lo:103: 00000100:00100000:3.0:1784938095.307304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938095.311482:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144102656 00000100:00100000:2.0:1784938095.311510:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144102656 00010000:00010000:2.0:1784938095.311571:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ede6f expref: 14 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938095.311615:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784938095.311624:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abb30789 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:3640:x1871643144102656:12345-0@lo:103: 00010000:00010000:2.0:1784938095.311643:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938095.311649:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ede6f expref: 14 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.311661:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ede6f expref: 14 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.311818:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.311852:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59ede6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede76 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938095.311881:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938095.311883:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938095.311885:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938095.311893:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938095.311896:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938095.311956:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008870fe3c/0x26783cd1c59ede76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ede6f expref: 14 pid: 6506 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.311986:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.311995:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938095.312016:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012153715s 00010000:00010000:2.0:1784938095.312021:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.312028:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.312034:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.312049:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.312055:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f14dfe24 already unused, calling callback (00000000d7b3c3e8) 00010000:00010000:2.0:1784938095.312059:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.312067:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.312292:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938095.312306:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938095.312406:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abb30789 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+13:3640:x1871643144102656:12345-0@lo:103: Request processed in 782us (5101us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.312415:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1784938095.312576:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.312585:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938095.312598:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938095.312711:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018740c38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144102656:0@lo:103: 00080000:10000000:0.0:1784938095.314282:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1784938095.314439:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784938095.314645:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1784938095.314846:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1784938095.315869:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1784938095.316671:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1784938095.317788:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1784938095.318083:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1784938095.318324:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1784938095.318484:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1784938095.318647:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1784938095.318847:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1784938095.336513:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1784938095.336755:0:7466:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1784938095.336760:0:7466:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1784938095.343002:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1784938095.343099:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007863f6a7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7467:1871643144102784:192.168.203.126@tcp:700: 00000100:00100000:2.0:1784938095.343286:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set 000000005bfcb829 going to sleep for 11 seconds 00000100:00100000:1.0:1784938095.345178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938095.347857:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144102784 00000100:00100000:2.0:1784938095.347883:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144102784 00000100:00100000:2.0:1784938095.347984:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:2.0:1784938095.347996:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2141bfc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7467:x1871643144102784:12345-192.168.203.126@tcp:700: 00000040:01000000:0.0:1784938095.348234:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1784938095.352044:0:7468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000015dcc2a9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144102912:192.168.203.126@tcp:1000: 00000100:00100000:3.0:1784938095.352210:0:7468:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097aae6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938095.352749:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938095.352793:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144102912 00000100:00100000:1.0:1784938095.352803:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144102912 00000100:00100000:1.0:1784938095.352868:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:1.0:1784938095.352877:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce4d378 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144102912:12345-192.168.203.126@tcp:1000: 00000100:00100000:1.0:1784938095.352986:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce4d378 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144102912:12345-192.168.203.126@tcp:1000: Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938095.352994:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 40000000:02000000:2.0:1784938095.355700:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:01000000:0.0:1784938095.356045:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1784938095.357159:0:7468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000015dcc2a9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144102912:192.168.203.126@tcp:1000: 00000040:01000000:3.0:1784938095.357242:0:7468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1784938095.357307:0:7468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000015dcc2a9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144103040:192.168.203.126@tcp:700: 00000100:00100000:3.0:1784938095.357420:0:7468:0:(client.c:2702:ptlrpc_set_wait()) set 0000000051a52f0c going to sleep for 11 seconds 00000100:00100000:1.0:1784938095.358330:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938095.358384:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144103040 00000100:00100000:1.0:1784938095.358393:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144103040 00000100:00100000:1.0:1784938095.358452:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:1.0:1784938095.358463:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ced51a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144103040:12345-192.168.203.126@tcp:700: 00000100:00100000:1.0:1784938095.358548:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ced51a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144103040:12345-192.168.203.126@tcp:700: Request processed in 87us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938095.358557:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000040:00080000:0.0:1784938095.360086:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784938095.360932:0:7442:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784938095.360956:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1784938095.361340:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938095.363206:0:7468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000015dcc2a9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144103040:192.168.203.126@tcp:700: 00000100:00100000:3.0:1784938095.363340:0:7468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000015dcc2a9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7468:1871643144103168:192.168.203.126@tcp:900: 00000100:00100000:3.0:1784938095.363443:0:7468:0:(client.c:2702:ptlrpc_set_wait()) set 0000000051a52f0c going to sleep for 11 seconds 00000040:00080000:0.0:1784938095.363963:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784938095.365114:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784938095.365194:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1784938095.365904:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938095.367425:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938095.367485:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144103168 00000100:00100000:1.0:1784938095.367496:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144103168 00000100:00100000:1.0:1784938095.367553:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:1.0:1784938095.367562:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c8dc135 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7468:x1871643144103168:12345-192.168.203.126@tcp:900: 00000100:00100000:1.0:1784938095.367658:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c8dc135 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7468:x1871643144103168:12345-192.168.203.126@tcp:900: Request processed in 97us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938095.367665:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00080000:10000000:0.0:1784938095.367786:0:7442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00010000:00080000:1.0:1784938095.367822:0:7468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000015dcc2a9 x1871643144103168/t0(0) o900->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:29/10 lens 264/248 e 0 to 0 dl 1784938111 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938095.367856:0:7468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000015dcc2a9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7468:1871643144103168:192.168.203.126@tcp:900: 00000100:00100000:1.0:1784938095.368028:0:7468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144103296:192.168.203.126@tcp:1000: 00000100:00100000:1.0:1784938095.368160:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938095.368185:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144103296 00000100:00100000:1.0:1784938095.368190:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144103296 00000100:00100000:1.0:1784938095.368248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:1.0:1784938095.368254:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a84ac15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144103296:12345-192.168.203.126@tcp:1000: 00000100:00100000:1.0:1784938095.368322:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a84ac15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144103296:12345-192.168.203.126@tcp:1000: Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938095.368328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:1.0:1784938095.368437:0:7468:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a389c4c going to sleep for 11 seconds 00000100:00100000:1.0:1784938095.368455:0:7468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144103296:192.168.203.126@tcp:1000: 00000004:00080000:1.0:1784938095.368502:0:7468:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000045f430e0 with version 0 00000020:00100000:1.0:1784938095.368517:0:7468:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784938095.368523:0:7468:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000038c78017 x1871643144103552/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.203.126@tcp:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938095.368535:0:7468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144103552:192.168.203.126@tcp:1000: 00000100:00100000:1.0:1784938095.368618:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938095.368632:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144103552 00000100:00100000:1.0:1784938095.368636:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144103552 00000100:00100000:1.0:1784938095.368655:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:1.0:1784938095.368660:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000578849a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144103552:12345-192.168.203.126@tcp:1000: 00000100:00100000:1.0:1784938095.369010:0:7468:0:(client.c:2702:ptlrpc_set_wait()) set 000000006c3704e4 going to sleep for 11 seconds 00100000:10000000:0.0:1784938095.373702:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1784938095.373913:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1784938095.374106:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000100:00100000:2.0:1784938095.374670:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2141bfc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7467:x1871643144102784:12345-192.168.203.126@tcp:700: Request processed in 26668us (29497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938095.374701:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000001:00080000:1.0:1784938095.376542:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1784938095.376659:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000578849a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144103552:12345-192.168.203.126@tcp:1000: Request processed in 7991us (8034us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784938095.379197:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00100000:10000000:1.0:1784938095.379939:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1784938095.380288:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000004:00080000:1.0:1784938095.380416:0:7468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1784938095.380422:0:7468:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784938095.380447:0:7468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144103552:192.168.203.126@tcp:1000: 00000100:00100000:1.0:1784938095.380556:0:7468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144103680:192.168.203.126@tcp:1000: 00000100:00100000:0.0:1784938095.381772:0:7468:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f5893975 going to sleep for 11 seconds 00100000:10000000:3.0:1784938095.382318:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1784938095.382467:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1784938095.382608:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1784938095.382777:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1784938095.382934:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1784938095.383091:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1784938095.383272:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1784938095.383434:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1784938095.383579:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1784938095.383720:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1784938095.383858:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1784938095.384279:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1784938095.384416:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1784938095.384569:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1784938095.384728:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1784938095.384904:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000100:00100000:1.0:1784938095.386055:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938095.386101:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144103680 00000100:00100000:1.0:1784938095.386113:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144103680 00000100:00100000:1.0:1784938095.386176:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:1.0:1784938095.386185:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cad29905 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144103680:12345-192.168.203.126@tcp:1000: 00000100:00100000:1.0:1784938095.386357:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cad29905 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7468:x1871643144103680:12345-192.168.203.126@tcp:1000: Request processed in 173us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938095.386365:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:1.0:1784938095.386570:0:7468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7468:1871643144103680:192.168.203.126@tcp:1000: 00000040:00080000:1.0:1784938095.386608:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1784938095.386660:0:7468:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000006c3704e4 with version 1 00000004:00080000:1.0:1784938095.386685:0:7457:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000893bc527 version 1 rpc_version 1 00000020:00100000:1.0:1784938095.386714:0:7457:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784938095.386723:0:7457:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000038c78017 x1871643144103936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@192.168.203.126@tcp:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938095.386762:0:7457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1871643144103936:192.168.203.126@tcp:1000: 00000100:00100000:1.0:1784938095.386828:0:7457:0:(client.c:2702:ptlrpc_set_wait()) set 0000000085cfd8a2 going to sleep for 11 seconds 00000100:00100000:1.0:1784938095.386909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938095.386925:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144103936 00000100:00100000:1.0:1784938095.386929:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144103936 00000100:00100000:1.0:1784938095.386954:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:1.0:1784938095.386961:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000917812a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7457:x1871643144103936:12345-192.168.203.126@tcp:1000: 00010000:00080000:2.0:1784938095.387709:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007863f6a7 x1871643144102784/t0(0) o700->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:32/10 lens 264/248 e 0 to 0 dl 1784938111 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938095.387726:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007863f6a7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7467:1871643144102784:192.168.203.126@tcp:700: 40000000:02000000:2.0:1784938095.387740:0:7467:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:0.0:1784938095.390631:0:7468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784938095.390775:0:7468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:3.0:1784938095.399540:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1784938095.399900:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1784938095.400092:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1784938095.400253:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1784938095.400387:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1784938095.400544:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1784938095.400707:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1784938095.400841:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1784938095.400976:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1784938095.401118:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1784938095.401312:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1784938095.401527:0:7442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1784938095.406052:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1784938095.407641:0:7442:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784938095.407696:0:7442:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb7d541c87988 00100000:10000000:0.0:1784938095.407757:0:7442:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:3.0:1784938095.410241:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000917812a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7457:x1871643144103936:12345-192.168.203.126@tcp:1000: Request processed in 23250us (23302us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784938095.410264:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00000020:01000004:0.0:1784938095.410962:0:7442:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784938095.411088:0:7442:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784938095.411116:0:7442:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784938095.411138:0:7442:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000004:00080000:3.0:1784938095.415402:0:7457:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1784938095.415412:0:7457:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784938095.415444:0:7457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1871643144103936:192.168.203.126@tcp:1000: 00000020:00000004:2.0:1784938095.433173:0:7442:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938095.433454:0:7442:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1784938095.454098:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938095.470498:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784938095.470620:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784938095.470625:0:7467:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1784938096.223332:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938097.252621:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938098.276612:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938099.298512:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938100.321116:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938100.385866:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad0d1cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144104064:0@lo:400: 00000100:00100000:3.0:1784938100.386138:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005668e8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144104320:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938100.386244:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938100.386251:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a97f1e27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144104192:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938100.386434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938100.386490:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938100.386517:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144104320 00000100:00100000:3.0:1784938100.386525:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144104320 00000100:00100000:3.0:1784938100.386568:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:3.0:1784938100.386576:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003425779e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144104320:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938100.386627:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003425779e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144104320:12345-192.168.203.126@tcp:400: Request processed in 51us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938100.386635:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:3.0:1784938100.386662:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144104192 00000100:00100000:3.0:1784938100.386666:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144104192 00000100:00100000:3.0:1784938100.386693:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:3.0:1784938100.386698:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b47aafd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144104192:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938100.386720:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b47aafd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144104192:12345-192.168.203.126@tcp:400: Request processed in 23us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938100.386725:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00010000:00080000:3.0:1784938100.386835:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a97f1e27 x1871643144104192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938100.386849:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a97f1e27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144104192:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938100.386860:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005668e8c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144104320:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938100.393560:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144104448:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938100.393836:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938100.393864:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144104448 00000100:00100000:1.0:1784938100.393871:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144104448 00000100:00100000:1.0:1784938100.393912:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:1.0:1784938100.393919:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000804488c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144104448:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938100.393981:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000804488c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144104448:12345-192.168.203.126@tcp:400: Request processed in 61us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938100.393988:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00010000:00080000:1.0:1784938100.394091:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005f13fc0d x1871643144104448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938100.394106:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144104448:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938100.394492:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938100.394503:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018740c38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144104576:192.168.203.126@tcp:41: 00000100:00100000:0.0:1784938100.397154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938100.399972:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144104576 00000100:00100000:3.0:1784938100.399987:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144104576 00000100:00100000:3.0:1784938100.400063:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:3.0:1784938100.400087:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046ff3cdd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144104576:12345-192.168.203.126@tcp:41: 00000004:00000024:3.0:1784938100.400125:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1784938100.400196:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046ff3cdd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144104576:12345-192.168.203.126@tcp:41: Request processed in 112us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938100.400203:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:0.0:1784938100.400450:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018740c38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144104576:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938100.400747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938100.400780:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144104064 00000100:00100000:2.0:1784938100.400785:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144104064 00000100:00100000:2.0:1784938100.400822:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784938100.400828:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e68e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+13:3641:x1871643144104064:12345-0@lo:400: 00000100:00100000:2.0:1784938100.400867:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e68e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+13:3641:x1871643144104064:12345-0@lo:400: Request processed in 38us (14931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938100.400873:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784938100.400923:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad0d1cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144104064:0@lo:400: 00000001:02000400:0.0:1784938100.718055:0:7713:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784938101.347274:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784938101.884431:0:7765:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938101.885514:0:7765:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1784938101.920540:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938101.920550:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cc481d800 from 4 10000000:01000000:0.0:1784938101.920556:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938101.920601:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59edf5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.920623:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59edf5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.920635:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59edf5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938101.920658:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018740c38 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144104704:0@lo:101: 00000100:00100000:0.0:1784938101.920738:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938101.920787:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000005547f5c1 going to sleep for 11 seconds 00000100:00100000:3.0:1784938101.920970:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144104704 00000100:00100000:3.0:1784938101.920978:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144104704 00000100:00100000:3.0:1784938101.921035:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784938101.921043:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004da16e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+13:6510:x1871643144104704:12345-0@lo:101: 00010000:00010000:3.0:1784938101.921067:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938101.921079:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edf5d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938101.921103:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edf5d expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938101.921113:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f14dfe24/0x26783cd1c59edf64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf5d expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938101.921122:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f14dfe24, rc 0) 00000100:00100000:3.0:1784938101.921169:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004da16e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:6510:x1871643144104704:12345-0@lo:101: Request processed in 127us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938101.921176:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784938101.921247:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018740c38 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144104704:0@lo:101: 00010000:00010000:3.0:1784938101.921260:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59edf5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938101.921269:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59edf5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938101.921329:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006a8ee1d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144104832:0@lo:256: 00000100:00100000:3.0:1784938101.921364:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938101.922351:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2ffe874 going to sleep for 11 seconds 00000100:00100000:1.0:1784938101.928564:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144104832 00000100:00100000:1.0:1784938101.928580:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144104832 00000100:00100000:1.0:1784938101.928644:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784938101.928653:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b4a30b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:6510:x1871643144104832:12345-0@lo:256: 20000000:01000000:1.0:1784938101.928682:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938101.928706:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938101.928709:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1784938101.928854:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b4a30b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:6510:x1871643144104832:12345-0@lo:256: Request processed in 202us (7490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938101.928862:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784938101.928945:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006a8ee1d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144104832:0@lo:256: 10000000:01000000:1.0:1784938101.928999:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938101.929007:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59edf5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.929028:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000efd4f29b/0x26783cd1c59edf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938101.929041:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938101.929043:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cca3c9000 from 21 10000000:01000000:1.0:1784938101.929053:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938101.929087:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000abd3f95f/0x26783cd1c59edf6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.929095:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000abd3f95f/0x26783cd1c59edf6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.929113:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000abd3f95f/0x26783cd1c59edf6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938101.929131:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144104960:0@lo:101: 00000100:00100000:1.0:1784938101.929164:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938101.929195:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030c567a5 going to sleep for 11 seconds 00000100:00100000:1.0:1784938101.929208:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144104960 00000100:00100000:1.0:1784938101.929236:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144104960 00000100:00100000:1.0:1784938101.929261:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784938101.929267:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfec11d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:6510:x1871643144104960:12345-0@lo:101: 00010000:00010000:1.0:1784938101.929275:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938101.929287:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008870fe3c/0x26783cd1c59edf72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edf6b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.929309:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008870fe3c/0x26783cd1c59edf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edf6b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.929318:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008870fe3c/0x26783cd1c59edf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf6b expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.929326:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008870fe3c, rc 0) 00000100:00100000:1.0:1784938101.929350:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfec11d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144104960:12345-0@lo:101: Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938101.929356:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784938101.929385:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144104960:0@lo:101: 00010000:00010000:1.0:1784938101.929395:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000abd3f95f/0x26783cd1c59edf6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.929412:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000abd3f95f/0x26783cd1c59edf6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938101.929466:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105088:0@lo:501: 00000100:00100000:1.0:1784938101.929489:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938101.929501:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030c567a5 going to sleep for 11 seconds 00000100:00100000:1.0:1784938101.929511:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144105088 00000100:00100000:1.0:1784938101.929514:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144105088 00000100:00100000:1.0:1784938101.929534:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784938101.929540:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ada99c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144105088:12345-0@lo:501: 00000100:00100000:1.0:1784938101.929648:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ada99c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144105088:12345-0@lo:501: Request processed in 108us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938101.929655:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784938101.929683:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105088:0@lo:501: 00000100:00100000:1.0:1784938101.929710:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105216:0@lo:503: 00000100:00100000:1.0:1784938101.929751:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938101.929764:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030c567a5 going to sleep for 11 seconds 00000100:00100000:1.0:1784938101.929773:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144105216 00000100:00100000:1.0:1784938101.929776:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144105216 00000100:00100000:1.0:1784938101.929793:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784938101.929798:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e637d300 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144105216:12345-0@lo:503: 00000100:00100000:1.0:1784938101.929876:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e637d300 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144105216:12345-0@lo:503: Request processed in 78us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938101.929883:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784938101.929936:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005f13fc0d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105216:0@lo:503: 00000100:00100000:3.0:1784938101.937716:0:7769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000056bfb6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:7769:1871643144105344:0@lo:502: 00000100:00100000:3.0:1784938101.937803:0:7769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938101.938319:0:7769:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1b807f8 going to sleep for 11 seconds 00000100:00100000:1.0:1784938101.940419:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144105344 00000100:00100000:1.0:1784938101.940432:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144105344 00000100:00100000:1.0:1784938101.940503:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784938101.940513:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6afb209 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7769:x1871643144105344:12345-0@lo:502: 00000100:00100000:1.0:1784938101.941265:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6afb209 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7769:x1871643144105344:12345-0@lo:502: Request processed in 751us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938101.941278:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784938101.941418:0:7769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000056bfb6f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:7769:1871643144105344:0@lo:502: 00000100:00100000:2.0:1784938101.941500:0:7769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007863f6a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:7769:1871643144105472:0@lo:502: 00000100:00100000:2.0:1784938101.942008:0:7769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938101.942164:0:7769:0:(client.c:2702:ptlrpc_set_wait()) set 00000000493deb58 going to sleep for 11 seconds 00000100:00100000:0.0:1784938101.942193:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144105472 00000100:00100000:0.0:1784938101.942200:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144105472 00000100:00100000:0.0:1784938101.942266:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784938101.942273:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001589bc12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7769:x1871643144105472:12345-0@lo:502: 00000100:00100000:0.0:1784938101.942400:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001589bc12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:7769:x1871643144105472:12345-0@lo:502: Request processed in 127us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938101.942408:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784938101.942686:0:7769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007863f6a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:7769:1871643144105472:0@lo:502: 00000040:00080000:2.0:1784938101.942718:0:7769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1784938101.943756:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1784938101.943784:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938101.943793:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000abd3f95f/0x26783cd1c59edf6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.943804:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000abd3f95f/0x26783cd1c59edf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938101.943813:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938101.943816:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cca3c9000 from 4 10000000:01000000:0.0:1784938101.943818:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938101.943851:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000365aee0b/0x26783cd1c59edf79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.943867:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000365aee0b/0x26783cd1c59edf79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.943877:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000365aee0b/0x26783cd1c59edf79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938101.943896:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105600:0@lo:101: 00000100:00100000:0.0:1784938101.944013:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938101.944063:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000005547f5c1 going to sleep for 11 seconds 00000100:00100000:1.0:1784938101.944112:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144105600 00000100:00100000:1.0:1784938101.944118:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144105600 00000100:00100000:1.0:1784938101.944161:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784938101.944168:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004774bcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144105600:12345-0@lo:101: 00010000:00010000:1.0:1784938101.944180:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938101.944192:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087295396/0x26783cd1c59edf80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edf79 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.944230:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087295396/0x26783cd1c59edf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edf79 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.944243:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087295396/0x26783cd1c59edf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf79 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938101.944251:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087295396, rc 0) 00000100:00100000:1.0:1784938101.944292:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004774bcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144105600:12345-0@lo:101: Request processed in 124us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938101.944298:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784938101.944305:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105600:0@lo:101: 00010000:00010000:0.0:1784938101.944320:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000365aee0b/0x26783cd1c59edf79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.944330:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000365aee0b/0x26783cd1c59edf79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938101.944376:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105728:0@lo:256: 00000100:00100000:0.0:1784938101.944406:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938101.945040:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000005547f5c1 going to sleep for 11 seconds 00000100:00100000:0.0:1784938101.945075:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144105728 00000100:00100000:0.0:1784938101.945080:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144105728 00000100:00100000:2.0:1784938101.948018:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784938101.948039:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000112dac3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144105728:12345-0@lo:256: 20000000:01000000:2.0:1784938101.949635:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784938101.949664:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784938101.949667:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1784938101.949809:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000112dac3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144105728:12345-0@lo:256: Request processed in 1777us (5400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938101.949820:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784938101.950073:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105728:0@lo:256: 10000000:01000000:0.0:1784938101.950364:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784938101.950373:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000365aee0b/0x26783cd1c59edf79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.950384:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000365aee0b/0x26783cd1c59edf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938101.950400:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784938101.950403:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1784938101.950405:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784938101.951634:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59edf87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.951649:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59edf87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.951659:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59edf87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938101.951680:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105856:0@lo:101: 00000100:00100000:0.0:1784938101.951735:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938101.951773:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000008532e938 going to sleep for 11 seconds 00000100:00100000:0.0:1784938101.953110:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144105856 00000100:00100000:0.0:1784938101.953120:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144105856 00000100:00100000:0.0:1784938101.953171:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784938101.953179:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089fa3aca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144105856:12345-0@lo:101: 00010000:00010000:0.0:1784938101.953195:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938101.953243:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e81e44f2/0x26783cd1c59edf8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edf87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.953270:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e81e44f2/0x26783cd1c59edf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edf87 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.953281:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e81e44f2/0x26783cd1c59edf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf87 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.953300:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e81e44f2, rc 0) 00000100:00100000:0.0:1784938101.953359:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089fa3aca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144105856:12345-0@lo:101: Request processed in 181us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938101.953365:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784938101.954065:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105856:0@lo:101: 00010000:00010000:0.0:1784938101.954084:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59edf87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.954093:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59edf87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938101.954170:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105984:0@lo:501: 00000100:00100000:0.0:1784938101.954208:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938101.954257:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000008532e938 going to sleep for 11 seconds 00000100:00100000:0.0:1784938101.954271:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144105984 00000100:00100000:0.0:1784938101.954276:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144105984 00000100:00100000:0.0:1784938101.954299:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784938101.954305:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5cd3f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144105984:12345-0@lo:501: 00000100:00100000:0.0:1784938101.954440:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5cd3f2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144105984:12345-0@lo:501: Request processed in 135us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938101.954447:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784938101.954483:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144105984:0@lo:501: 00000100:00100000:0.0:1784938101.954511:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144106112:0@lo:503: 00000100:00100000:0.0:1784938101.954567:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938101.954580:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000008532e938 going to sleep for 11 seconds 00000100:00100000:0.0:1784938101.954597:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144106112 00000100:00100000:0.0:1784938101.954600:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144106112 00000100:00100000:0.0:1784938101.954618:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784938101.954623:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000079f1d85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144106112:12345-0@lo:503: 00000100:00100000:0.0:1784938101.954694:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000079f1d85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144106112:12345-0@lo:503: Request processed in 71us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938101.954700:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784938101.954732:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144106112:0@lo:503: 00000100:00100000:0.0:1784938101.954880:0:7771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:7771:1871643144106240:0@lo:502: 00000100:00100000:0.0:1784938101.954911:0:7771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938101.954939:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144106240 00000100:00100000:0.0:1784938101.954943:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144106240 00000100:00100000:0.0:1784938101.956697:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784938101.956712:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a462694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:7771:x1871643144106240:12345-0@lo:502: 00000100:00100000:0.0:1784938101.956865:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a462694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:7771:x1871643144106240:12345-0@lo:502: Request processed in 157us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938101.956872:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784938101.956918:0:7771:0:(client.c:2702:ptlrpc_set_wait()) set 000000005547f5c1 going to sleep for 11 seconds 00000100:00100000:0.0:1784938101.958111:0:7771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:7771:1871643144106240:0@lo:502: 00000020:01000000:0.0:1784938101.958156:0:7771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938101.958168:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938101.958170:0:7771:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1784938101.958176:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938101.958180:0:7771:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:0.0:1784938101.958206:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938101.958277:0:7771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000aea188e9) 00000020:00000080:0.0:1784938101.958301:0:7771:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1784938101.958316:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938101.958413:0:7771:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1784938101.958471:0:7771:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784938101.958480:0:7771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59edf9c 00010000:00080000:0.0:1784938101.958514:0:7771:0:(ldlm_lib.c:125:import_set_conn()) imp 0000000055551896@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1784938101.964523:0:7771:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1784938101.973022:0:7771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938101.973039:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784938101.973098:0:7771:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784938101.973126:0:7771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59edfa3 00000100:00080000:2.0:1784938101.973141:0:7771:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:2.0:1784938101.973152:0:7771:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000055551896 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938101.973189:0:7771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007863f6a7 x1871643144106368/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938101.973210:0:7771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1784938101.973270:0:7771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1784938101.973837:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007863f6a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144106368:192.168.203.126@tcp:38: 00000100:00100000:2.0:1784938101.974206:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938101.974258:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144106496:0@lo:400: 00000100:00100000:2.0:1784938101.974295:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938101.979377:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000057610251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144106752:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938101.979474:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938101.979483:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f3ae7ea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144106880:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938101.979681:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938101.979752:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938101.979890:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fd6fbb8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144106624:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938101.980018:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938101.980062:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144106368 00000100:00100000:3.0:1784938101.980069:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144106368 00000100:00100000:3.0:1784938101.980095:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144106752 00000100:00100000:3.0:1784938101.980098:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144106752 00000100:00100000:3.0:1784938101.980123:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:3.0:1784938101.980129:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f19e472 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1871643144106368:12345-192.168.203.126@tcp:38: 00010000:00080000:3.0:1784938101.980159:0:6518:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1784938101.980196:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59edfaa 00000004:00100000:3.0:1784938101.980208:0:6518:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1784938101.980235:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1784938101.980311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144106880 00000100:00100000:3.0:1784938101.980315:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144106880 00000100:00100000:3.0:1784938101.980338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144106624 00000100:00100000:3.0:1784938101.980340:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144106624 00000100:00100000:3.0:1784938101.980353:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:3.0:1784938101.980359:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0f1139c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144106880:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938101.980400:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0f1139c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144106880:12345-192.168.203.126@tcp:400: Request processed in 41us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938101.980419:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:3.0:1784938101.980437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:3.0:1784938101.980442:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc72cb4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144106624:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938101.980466:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc72cb4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144106624:12345-192.168.203.126@tcp:400: Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938101.980471:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00010000:00080000:3.0:1784938101.980607:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f3ae7ea9 x1871643144106880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938101.980622:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f3ae7ea9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144106880:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938101.980648:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fd6fbb8b x1871643144106624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938101.980656:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fd6fbb8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144106624:192.168.203.126@tcp:400: 00000020:01000000:2.0:1784938101.986135:0:7771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938101.986146:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938101.986148:0:7771:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1784938101.986160:0:7771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938101.986164:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938101.986166:0:7771:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938101.986168:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938101.986170:0:7771:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784938101.986208:0:7771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000091c9602b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:7771:1871643144107008:0@lo:502: 00000100:00100000:3.0:1784938101.986420:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144106496 00000100:00100000:3.0:1784938101.986429:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144106496 00000100:00100000:3.0:1784938101.986479:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784938101.986486:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b891603 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:3642:x1871643144106496:12345-0@lo:400: 00000100:00100000:3.0:1784938101.986580:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b891603 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:3642:x1871643144106496:12345-0@lo:400: Request processed in 95us (12285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938101.986588:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1784938101.986854:0:7775:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000007328e967 x1871643144107136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938101.986866:0:7775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b37663c5 going to sleep for 0 seconds 00000100:00100000:3.0:1784938101.989706:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a070a39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144106496:0@lo:400: 00000100:00100000:2.0:1784938101.994746:0:7771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938101.994796:0:7771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d4667dfc going to sleep for 11 seconds 00000100:00100000:0.0:1784938101.994859:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144107008 00000100:00100000:0.0:1784938101.994868:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144107008 00000100:00100000:0.0:1784938101.994930:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784938101.994938:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c3ed7a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:7771:x1871643144107008:12345-0@lo:502: 00000100:00100000:0.0:1784938101.995240:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c3ed7a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:7771:x1871643144107008:12345-0@lo:502: Request processed in 276us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938101.995249:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784938101.995355:0:7771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000091c9602b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:7771:1871643144107008:0@lo:502: 00000020:01000000:2.0:1784938101.995390:0:7771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938101.995398:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938101.995400:0:7771:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784938101.995404:0:7771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1784938101.995564:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1784938101.995585:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784938101.995593:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59edf87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.995616:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000f59a56ed/0x26783cd1c59edf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938101.995627:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784938101.995629:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff910cf3bf8000 from 1 10000000:01000000:0.0:1784938101.995633:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784938101.995662:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000006adef790/0x26783cd1c59edfb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.995669:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000006adef790/0x26783cd1c59edfb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938101.995678:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000006adef790/0x26783cd1c59edfb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938101.995695:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089139152 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144107264:0@lo:101: 00000100:00100000:0.0:1784938101.995728:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938101.995757:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a389c4c going to sleep for 11 seconds 00000100:00100000:2.0:1784938101.995854:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144107264 00000100:00100000:2.0:1784938101.995860:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144107264 00000100:00100000:2.0:1784938101.995895:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784938101.995902:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ed8bcd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144107264:12345-0@lo:101: 00010000:00010000:2.0:1784938101.995910:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938101.995933:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030dd8fee/0x26783cd1c59edfb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edfb1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938101.995962:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030dd8fee/0x26783cd1c59edfb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edfb1 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938101.995971:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030dd8fee/0x26783cd1c59edfb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edfb1 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938101.995980:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030dd8fee, rc 0) 00000100:00100000:2.0:1784938101.996013:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ed8bcd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144107264:12345-0@lo:101: Request processed in 112us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938101.996028:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784938101.996177:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089139152 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144107264:0@lo:101: 00010000:00010000:2.0:1784938101.996190:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000006adef790/0x26783cd1c59edfb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938101.996199:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000006adef790/0x26783cd1c59edfb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938101.996276:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000091c9602b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144107392:0@lo:501: 00000100:00100000:2.0:1784938101.996303:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938101.996317:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000217e5fe5 going to sleep for 11 seconds 00000100:00100000:2.0:1784938101.996329:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144107392 00000100:00100000:2.0:1784938101.996333:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144107392 00000100:00100000:2.0:1784938101.996355:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784938101.996361:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0c4e144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144107392:12345-0@lo:501: 00000100:00100000:2.0:1784938101.996430:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0c4e144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144107392:12345-0@lo:501: Request processed in 70us (127us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938101.996437:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784938101.996466:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000091c9602b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144107392:0@lo:501: 10000000:01000000:2.0:1784938101.996486:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784938101.996491:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 000000006adef790/0x26783cd1c59edfb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938101.996498:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 000000006adef790/0x26783cd1c59edfb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784938102.010328:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000c427eaf1 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938102.010411:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f19e472 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1871643144106368:12345-192.168.203.126@tcp:38: Request processed in 30279us (36204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938102.010751:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938102.010767:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784938102.010776:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784938102.010782:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784938102.010785:0:3639:0:(import.c:65:import_set_state_nolock()) 0000000055551896 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1784938102.010797:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b37663c5): req@000000007328e967 x1871643144107136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938102.010811:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007863f6a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144106368:192.168.203.126@tcp:38: 00000100:00100000:0.0:1784938102.011011:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938102.011025:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5b6764c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144107520:192.168.203.126@tcp:41: 00000100:00100000:0.0:1784938102.011116:0:7775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b37663c5 going to sleep for 11 seconds 00000100:00100000:2.0:1784938102.011306:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938102.011328:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938102.011343:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1784938102.011350:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1784938102.011614:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:1.0:1784938102.011638:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144107520 00000100:00100000:1.0:1784938102.011643:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144107520 00000100:00100000:1.0:1784938102.011666:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144107136 00000100:00100000:1.0:1784938102.011669:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144107136 00000100:00100000:1.0:1784938102.011682:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:1.0:1784938102.011689:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018740c38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144106752:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938102.011747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018740c38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144106752:12345-192.168.203.126@tcp:400: Request processed in 58us (32068us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938102.011754:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:1.0:1784938102.011766:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:1.0:1784938102.011771:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007863f6a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1871643144107520:12345-192.168.203.126@tcp:41: 00000004:00000024:1.0:1784938102.011791:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784938102.011817:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007863f6a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1871643144107520:12345-192.168.203.126@tcp:41: Request processed in 46us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938102.011824:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:1.0:1784938102.011837:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:1.0:1784938102.011841:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091c9602b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7775:x1871643144107136:12345-192.168.203.126@tcp:1000: 00000100:00100000:1.0:1784938102.011894:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091c9602b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7775:x1871643144107136:12345-192.168.203.126@tcp:1000: Request processed in 52us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938102.011900:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:0.0:1784938102.012398:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000057610251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144106752:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938102.012442:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5b6764c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144107520:192.168.203.126@tcp:41: 00000100:00100000:3.0:1784938102.012575:0:7775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007328e967 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144107136:192.168.203.126@tcp:1000: 00000040:01000000:3.0:1784938102.012607:0:7775:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784938102.012658:0:7775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000056bfb6f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144107648:192.168.203.126@tcp:1000: 00000100:00100000:3.0:1784938102.012716:0:7775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d075a2ab going to sleep for 11 seconds 00000100:00100000:2.0:1784938102.012969:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938102.013000:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144107648 00000100:00100000:2.0:1784938102.013005:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144107648 00000100:00100000:2.0:1784938102.013033:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:2.0:1784938102.013039:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008106f853 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7775:x1871643144107648:12345-192.168.203.126@tcp:1000: 00000100:00100000:2.0:1784938102.013395:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008106f853 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7775:x1871643144107648:12345-192.168.203.126@tcp:1000: Request processed in 354us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938102.013403:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:2.0:1784938102.014642:0:7775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000056bfb6f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144107648:192.168.203.126@tcp:1000: 00000100:00100000:2.0:1784938102.014707:0:7775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000434364ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144107776:192.168.203.126@tcp:700: 00000100:00100000:2.0:1784938102.015759:0:7775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000217e5fe5 going to sleep for 11 seconds 00000100:00100000:2.0:1784938102.017199:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938102.017580:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144107776 00000100:00100000:1.0:1784938102.017589:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144107776 00000100:00100000:1.0:1784938102.017649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:1.0:1784938102.017658:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c9fd82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7775:x1871643144107776:12345-192.168.203.126@tcp:700: 00000100:00100000:1.0:1784938102.017948:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c9fd82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7775:x1871643144107776:12345-192.168.203.126@tcp:700: Request processed in 291us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938102.017957:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:1.0:1784938102.018572:0:7775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000434364ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144107776:192.168.203.126@tcp:700: 00000100:00100000:2.0:1784938102.019658:0:7775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fbd29038 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144107904:192.168.203.126@tcp:1000: 00000100:00100000:2.0:1784938102.019779:0:7775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ea1701fa going to sleep for 11 seconds 00000100:00100000:1.0:1784938102.022887:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938102.025187:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144107904 00000100:00100000:2.0:1784938102.025200:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144107904 00000100:00100000:0.0:1784938102.025416:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:0.0:1784938102.025488:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f13fc0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7775:x1871643144107904:12345-192.168.203.126@tcp:1000: 00000100:00100000:0.0:1784938102.025602:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f13fc0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7775:x1871643144107904:12345-192.168.203.126@tcp:1000: Request processed in 117us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938102.025616:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:3.0:1784938102.026457:0:7775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fbd29038 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144107904:192.168.203.126@tcp:1000: 00000004:00080000:3.0:1784938102.026532:0:7775:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000000ad016af with version 0 00000020:00100000:3.0:1784938102.026655:0:7775:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784938102.026664:0:7775:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006a8ee1d6 x1871643144108160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938102.026684:0:7775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006a8ee1d6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144108160:192.168.203.126@tcp:1000: 00000100:00100000:3.0:1784938102.030252:0:7775:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1b807f8 going to sleep for 11 seconds 00000100:00100000:1.0:1784938102.030613:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938102.030645:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144108160 00000100:00100000:1.0:1784938102.030653:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144108160 00000100:00100000:1.0:1784938102.030701:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:1.0:1784938102.030710:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087a41489 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7775:x1871643144108160:12345-192.168.203.126@tcp:1000: 00000001:00080000:2.0:1784938102.033565:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1784938102.033578:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784938102.034895:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087a41489 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7775:x1871643144108160:12345-192.168.203.126@tcp:1000: Request processed in 4177us (4278us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784938102.034909:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00000004:00080000:3.0:1784938102.035291:0:7775:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1784938102.035296:0:7775:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784938102.035311:0:7775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006a8ee1d6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144108160:192.168.203.126@tcp:1000: 00000100:00100000:3.0:1784938102.035401:0:7775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006a8ee1d6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144108288:192.168.203.126@tcp:1000: 00000100:00100000:3.0:1784938102.035470:0:7775:0:(client.c:2702:ptlrpc_set_wait()) set 000000007e727a89 going to sleep for 11 seconds 00000100:00100000:2.0:1784938102.035651:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938102.035678:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144108288 00000100:00100000:2.0:1784938102.035684:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144108288 00000100:00100000:2.0:1784938102.035723:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:2.0:1784938102.035731:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000832bf308 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7775:x1871643144108288:12345-192.168.203.126@tcp:1000: 00000100:00100000:2.0:1784938102.035801:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000832bf308 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7775:x1871643144108288:12345-192.168.203.126@tcp:1000: Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938102.035808:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:3.0:1784938102.036078:0:7775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006a8ee1d6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7775:1871643144108288:192.168.203.126@tcp:1000: 00000040:00080000:3.0:1784938102.036097:0:7775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1784938102.036132:0:7775:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000a1b807f8 with version 1 00000004:00080000:2.0:1784938102.038057:0:7772:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000009ff2b2a7 version 1 rpc_version 1 00000020:00100000:2.0:1784938102.038105:0:7772:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784938102.038116:0:7772:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004f199c2a x1871643144108544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938102.038137:0:7772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004f199c2a pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7772:1871643144108544:192.168.203.126@tcp:1000: 00000100:00100000:2.0:1784938102.038247:0:7772:0:(client.c:2702:ptlrpc_set_wait()) set 0000000088fded95 going to sleep for 11 seconds 00000100:00100000:1.0:1784938102.038643:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938102.038674:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144108544 00000100:00100000:1.0:1784938102.038680:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144108544 00000100:00100000:1.0:1784938102.038727:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:1.0:1784938102.038734:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad0d1cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7772:x1871643144108544:12345-192.168.203.126@tcp:1000: 00000040:00080000:3.0:1784938102.042363:0:7775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784938102.042446:0:7775:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1784938102.042451:0:7775:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1784938102.048266:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1784938102.048504:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad0d1cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7772:x1871643144108544:12345-192.168.203.126@tcp:1000: Request processed in 9764us (9857us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784938102.048518:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 17 00000004:00080000:2.0:1784938102.050697:0:7772:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1784938102.050708:0:7772:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784938102.050732:0:7772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004f199c2a pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7772:1871643144108544:192.168.203.126@tcp:1000: 00010000:00010000:2.0:1784938102.367326:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938103.393237:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938104.424252:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784938104.764425:0:7872:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784938104.764614:0:7872:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784938105.441938:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938105.503545:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938105.503581:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5b6764c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144108672:192.168.203.126@tcp:41: 00000100:00100000:0.0:1784938105.504614:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938105.504700:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144108672 00000100:00100000:1.0:1784938105.504710:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144108672 00000100:00100000:1.0:1784938105.504764:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:1.0:1784938105.504773:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057610251 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144108672:12345-192.168.203.126@tcp:41: 00000004:00000024:1.0:1784938105.504826:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1784938105.504889:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057610251 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144108672:12345-192.168.203.126@tcp:41: Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938105.504895:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:1.0:1784938105.505048:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5b6764c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144108672:192.168.203.126@tcp:41: 00000020:00000080:2.0:1784938105.720778:0:7920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1e411fd0 20000000:00000080:2.0:1784938105.720796:0:7920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910cfcfb6000 uarg=0000000000000000 20000000:01000000:2.0:1784938105.720847:0:7920:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1784938105.720857:0:7920:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1784938105.720862:0:7920:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1784938105.720951:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1784938105.720965:0:7920:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1784938105.730071:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938105.730550:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784938105.730588:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1784938105.730607:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1784938105.730629:0:7920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784938105.730646:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938105.730666:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ede37 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938105.730673:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf25 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938105.730679:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938105.730716:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edf25 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938105.730730:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edf25 expref: 17 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938105.730743:0:7920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004f199c2a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871643144108800:0@lo:104: 00000100:00100000:2.0:1784938105.730811:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938105.730875:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ede37 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938105.730892:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ede37 expref: 17 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938105.730916:0:7920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fbd29038 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871643144108928:0@lo:104: 00000100:00100000:2.0:1784938105.730938:0:7920:0:(client.c:2702:ptlrpc_set_wait()) set 000000004bebb47d going to sleep for 11 seconds 00000100:00100000:1.0:1784938105.730953:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784938105.730970:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938105.730998:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144108800 00000100:00100000:1.0:1784938105.731005:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144108800 00000100:00100000:1.0:1784938105.731053:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144108928 00000100:00100000:1.0:1784938105.731056:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144108928 00000100:00100000:1.0:1784938105.731071:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938105.731078:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b296f256 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:7920:x1871643144108800:12345-0@lo:104: 00010000:00010000:1.0:1784938105.731089:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731151:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938105.731155:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b296f256 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:7920:x1871643144108800:12345-0@lo:104: Request processed in 79us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938105.731162:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938105.731209:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784938105.731232:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005668e8c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:7920:x1871643144108928:12345-0@lo:104: 00010000:00010000:1.0:1784938105.731239:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731272:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784938105.731276:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005668e8c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:7920:x1871643144108928:12345-0@lo:104: Request processed in 62us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938105.731287:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1784938105.731302:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938105.731307:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731314:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6358bd5 already unused, calling callback (0000000003bcf0ae) 10000000:00010000:1.0:1784938105.731317:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731325:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938105.731331:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938105.731337:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784938105.731361:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731368:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938105.731383:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731388:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000f6358bd5/0x26783cd1c59edf25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf2c expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731401:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938105.731403:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731417:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079d41796 already unused, calling callback (0000000003bcf0ae) 10000000:00010000:1.0:1784938105.731419:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731425:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938105.731430:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938105.731435:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784938105.731445:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731450:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938105.731454:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731459:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000079d41796/0x26783cd1c59ede37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ede3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731472:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938105.731474:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938105.731475:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938105.731491:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144109184:0@lo:103: 00000100:00100000:1.0:1784938105.731531:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938105.731553:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938105.731558:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a97f1e27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144109056:0@lo:103: 00000100:00100000:1.0:1784938105.731587:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938105.731612:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144109184 00000100:00100000:1.0:1784938105.731616:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144109184 00010000:00010000:1.0:1784938105.731923:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ede37 expref: 18 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938105.731944:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144109056 00000100:00100000:1.0:1784938105.731947:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144109056 00010000:00010000:1.0:1784938105.731956:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf25 expref: 19 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938105.731968:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938105.731973:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a974ae9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+19:3641:x1871643144109184:12345-0@lo:103: 00010000:00010000:1.0:1784938105.731982:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938105.731986:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ede37 expref: 19 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.731994:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ede37 expref: 19 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938105.732008:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938105.732140:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784938105.732149:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1784938105.732313:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938105.732323:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061b753ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+19:3641:x1871643144109056:12345-0@lo:103: 00010000:00010000:3.0:1784938105.732332:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938105.732335:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf25 expref: 19 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732343:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edf25 expref: 19 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732353:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732361:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732372:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732378:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732383:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732389:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732394:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001495d4da already unused, calling callback (00000000d7b3c3e8) 00010000:00010000:3.0:1784938105.732398:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732405:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732417:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938105.732426:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938105.732453:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061b753ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+19:3641:x1871643144109056:12345-0@lo:103: Request processed in 130us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938105.732459:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784938105.732806:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a974ae9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:3641:x1871643144109184:12345-0@lo:103: Request processed in 831us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938105.732813:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938105.732856:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a97f1e27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144109056:0@lo:103: 00000100:00100000:1.0:1784938105.732866:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038c78017 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144109184:0@lo:103: 00010000:00010000:1.0:1784938105.733441:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938105.734163:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e7017916/0x26783cd1c59edf2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edf25 expref: 17 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938105.734178:0:7920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004f199c2a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871643144108800:0@lo:104: 00010000:00010000:2.0:1784938105.734188:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000829e9691/0x26783cd1c59ede3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ede37 expref: 16 pid: 6506 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938105.734197:0:7920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fbd29038 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1871643144108928:0@lo:104: 00010000:00010000:2.0:1784938105.734230:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938105.734239:0:7920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938105.734244:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938105.734249:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001495d4da/0x26783cd1c59edfbf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938106.464195:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938107.043512:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fbd29038 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144109312:0@lo:400: 00000100:00100000:2.0:1784938107.043584:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938107.043645:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144109312 00000100:00100000:0.0:1784938107.043653:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144109312 00000100:00100000:2.0:1784938107.043658:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b4bda49c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144109824:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938107.043706:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784938107.043714:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b78fddb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:3642:x1871643144109312:12345-0@lo:400: 00000100:00100000:2.0:1784938107.043732:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938107.043742:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004f199c2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144109440:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938107.043871:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fbd29038 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144109312:0@lo:400: 00000100:00100000:2.0:1784938107.043887:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938107.043903:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe08897d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144109952:192.168.203.126@tcp:41: 00000100:00100000:0.0:1784938107.048404:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b78fddb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:3642:x1871643144109312:12345-0@lo:400: Request processed in 4681us (4811us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938107.048420:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784938107.049133:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000434364ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144109568:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938107.049178:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938107.049186:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073a2a81f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144109696:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938107.049285:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938107.049458:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938107.049486:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938107.049513:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938107.049534:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938107.049554:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144109440 00000100:00100000:2.0:1784938107.049561:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144109440 00000100:00100000:2.0:1784938107.049602:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144109696 00000100:00100000:2.0:1784938107.049605:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144109696 00000100:00100000:1.0:1784938107.049981:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144109824 00000100:00100000:1.0:1784938107.049986:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144109824 00000100:00100000:1.0:1784938107.050015:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144109952 00000100:00100000:1.0:1784938107.050018:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144109952 00000100:00100000:1.0:1784938107.050029:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144109568 00000100:00100000:1.0:1784938107.050032:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144109568 00000100:00100000:1.0:1784938107.050047:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:1.0:1784938107.050056:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbd29038 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144109824:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938107.050118:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbd29038 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144109824:12345-192.168.203.126@tcp:400: Request processed in 63us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938107.050126:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:1.0:1784938107.050140:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:1.0:1784938107.050146:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c253716 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144109952:12345-192.168.203.126@tcp:41: 00000004:00000024:1.0:1784938107.050170:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784938107.050196:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c253716 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144109952:12345-192.168.203.126@tcp:41: Request processed in 51us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938107.050202:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:1.0:1784938107.050235:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:1.0:1784938107.050242:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0fa063d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144109568:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938107.050267:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0fa063d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144109568:12345-192.168.203.126@tcp:400: Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938107.050273:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:2.0:1784938107.052963:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:2.0:1784938107.052978:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf7c00c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144109440:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938107.053045:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf7c00c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144109440:12345-192.168.203.126@tcp:400: Request processed in 73us (3589us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938107.053052:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:2.0:1784938107.053069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:2.0:1784938107.053074:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a37cbca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144109696:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938107.053102:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a37cbca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144109696:12345-192.168.203.126@tcp:400: Request processed in 29us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938107.053108:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00010000:00080000:0.0:1784938107.056874:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000073a2a81f x1871643144109696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938107.056905:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073a2a81f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144109696:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938107.056920:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000434364ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144109568:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938107.056974:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe08897d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144109952:192.168.203.126@tcp:41: 00010000:00080000:0.0:1784938107.056987:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004f199c2a x1871643144109440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938107.056995:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004f199c2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144109440:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938107.057004:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b4bda49c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144109824:192.168.203.126@tcp:400: 00010000:00010000:1.0:1784938107.487444:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938108.513613:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784938108.513932:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938108.513937:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cc481d800 from 1 10000000:01000000:2.0:1784938108.513940:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938108.513984:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000ee3ea0e1/0x26783cd1c59edfc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938108.513997:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000ee3ea0e1/0x26783cd1c59edfc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938108.514007:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000ee3ea0e1/0x26783cd1c59edfc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938108.514030:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b4bda49c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110080:0@lo:101: 00000100:00100000:2.0:1784938108.514101:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938108.514155:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 000000008349f3aa going to sleep for 11 seconds 00000100:00100000:1.0:1784938108.514203:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144110080 00000100:00100000:1.0:1784938108.514211:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144110080 00000100:00100000:1.0:1784938108.514296:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784938108.514304:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dcc4f67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144110080:12345-0@lo:101: 00010000:00010000:1.0:1784938108.514317:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938108.514342:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079d41796/0x26783cd1c59edfcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edfc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938108.514364:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079d41796/0x26783cd1c59edfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edfc6 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938108.514373:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079d41796/0x26783cd1c59edfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edfc6 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938108.514380:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079d41796, rc 0) 00000100:00100000:1.0:1784938108.514439:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dcc4f67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144110080:12345-0@lo:101: Request processed in 136us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938108.514446:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784938108.514493:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b4bda49c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110080:0@lo:101: 00010000:00010000:1.0:1784938108.514508:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000ee3ea0e1/0x26783cd1c59edfc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938108.514515:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000ee3ea0e1/0x26783cd1c59edfc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938108.514855:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083bdd03e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110208:0@lo:501: 00000100:00100000:1.0:1784938108.514901:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938108.514917:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000261109ae going to sleep for 11 seconds 00000100:00100000:1.0:1784938108.514933:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144110208 00000100:00100000:1.0:1784938108.514936:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144110208 00000100:00100000:1.0:1784938108.514966:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784938108.514972:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ec318f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144110208:12345-0@lo:501: 00000100:00100000:1.0:1784938108.515096:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ec318f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144110208:12345-0@lo:501: Request processed in 124us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938108.515114:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784938108.515153:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083bdd03e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110208:0@lo:501: 00000100:00100000:1.0:1784938108.515180:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083bdd03e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110336:0@lo:503: 00000100:00100000:1.0:1784938108.515240:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938108.515253:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set 00000000261109ae going to sleep for 11 seconds 00000100:00100000:1.0:1784938108.515264:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144110336 00000100:00100000:1.0:1784938108.515267:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144110336 00000100:00100000:1.0:1784938108.515305:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784938108.515309:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a49d3488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144110336:12345-0@lo:503: 00000100:00100000:1.0:1784938108.515501:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a49d3488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144110336:12345-0@lo:503: Request processed in 191us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938108.515508:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784938108.515674:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083bdd03e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110336:0@lo:503: 00000100:00100000:1.0:1784938108.515965:0:8043:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083bdd03e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8043:1871643144110464:0@lo:502: 00000100:00100000:1.0:1784938108.516002:0:8043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938108.516022:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144110464 00000100:00100000:1.0:1784938108.516025:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144110464 00000100:00100000:1.0:1784938108.516046:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784938108.516052:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044055fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:8043:x1871643144110464:12345-0@lo:502: 00000100:00100000:1.0:1784938108.516121:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044055fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:8043:x1871643144110464:12345-0@lo:502: Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938108.516128:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784938108.516251:0:8043:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030c567a5 going to sleep for 11 seconds 00000100:00100000:0.0:1784938108.516267:0:8043:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083bdd03e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8043:1871643144110464:0@lo:502: 00000020:01000000:0.0:1784938108.516312:0:8043:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938108.516323:0:8043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938108.516325:0:8043:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784938108.516331:0:8043:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cc481d800 00000020:00000080:0.0:1784938108.516334:0:8043:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784938108.516378:0:8043:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8043:1871643144110592:0@lo:502: 00000100:00100000:0.0:1784938108.516427:0:8043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938108.516439:0:8043:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc595b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938108.516790:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144110592 00000100:00100000:2.0:1784938108.516796:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144110592 00000100:00100000:2.0:1784938108.516820:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784938108.516827:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:8043:x1871643144110592:12345-0@lo:502: 00000100:00100000:2.0:1784938108.516923:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:8043:x1871643144110592:12345-0@lo:502: Request processed in 96us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938108.516930:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784938108.517033:0:8043:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8043:1871643144110592:0@lo:502: 00000020:01000000:0.0:1784938108.517052:0:8043:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938108.517057:0:8043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938108.517058:0:8043:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784938108.517062:0:8043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1784938108.517204:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784938108.517470:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938108.517481:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938108.517498:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938108.517508:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938108.517510:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cca3c9000 from 1 10000000:01000000:1.0:1784938108.517513:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938108.517538:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938108.517545:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938108.517621:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938108.517638:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110720:0@lo:101: 00000100:00100000:1.0:1784938108.517679:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938108.518012:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938108.525524:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144110720 00000100:00100000:2.0:1784938108.525540:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144110720 00000100:00100000:2.0:1784938108.525899:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784938108.525909:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144110720:12345-0@lo:101: 00010000:00010000:2.0:1784938108.525932:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938108.525951:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edfd4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938108.525979:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edfd4 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938108.525990:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edfd4 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938108.525999:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1200, rc 0) 00000100:00100000:2.0:1784938108.526091:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144110720:12345-0@lo:101: Request processed in 183us (8410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938108.526097:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784938108.526188:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110720:0@lo:101: 00010000:00010000:3.0:1784938108.526205:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938108.526231:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938108.526322:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110848:0@lo:501: 00000100:00100000:3.0:1784938108.526359:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938108.531781:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd2947b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938108.532225:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144110848 00000100:00100000:1.0:1784938108.532236:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144110848 00000100:00100000:1.0:1784938108.532479:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784938108.532489:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144110848:12345-0@lo:501: 00000100:00100000:1.0:1784938108.532772:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144110848:12345-0@lo:501: Request processed in 215us (6342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938108.532780:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784938108.532946:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110848:0@lo:501: 00000100:00100000:3.0:1784938108.533018:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110976:0@lo:503: 00000100:00100000:3.0:1784938108.533066:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938108.533099:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd2947b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938108.533206:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144110976 00000100:00100000:1.0:1784938108.533211:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144110976 00000100:00100000:1.0:1784938108.533260:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784938108.533289:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144110976:12345-0@lo:503: 00000100:00100000:1.0:1784938108.533363:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144110976:12345-0@lo:503: Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938108.533370:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784938108.533831:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144110976:0@lo:503: 00000100:00100000:3.0:1784938108.535653:0:8045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8045:1871643144111104:0@lo:502: 00000100:00100000:3.0:1784938108.535817:0:8045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938108.535860:0:8045:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd29479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938108.537687:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144111104 00000100:00100000:1.0:1784938108.537774:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144111104 00000100:00100000:1.0:1784938108.537842:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784938108.537852:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:8045:x1871643144111104:12345-0@lo:502: 00000100:00100000:1.0:1784938108.539068:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:8045:x1871643144111104:12345-0@lo:502: Request processed in 1211us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938108.539080:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784938108.539545:0:8045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8045:1871643144111104:0@lo:502: 00000020:01000000:3.0:1784938108.539599:0:8045:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938108.539609:0:8045:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938108.539612:0:8045:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784938108.539623:0:8045:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cca3c9000 00000020:00000080:3.0:1784938108.539625:0:8045:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784938108.539664:0:8045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8045:1871643144111232:0@lo:502: 00000100:00100000:3.0:1784938108.539729:0:8045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938108.539767:0:8045:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfa34840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938108.539821:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144111232 00000100:00100000:0.0:1784938108.539828:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144111232 00000100:00100000:0.0:1784938108.539873:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784938108.539893:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:8045:x1871643144111232:12345-0@lo:502: 00000100:00100000:0.0:1784938108.540006:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:8045:x1871643144111232:12345-0@lo:502: Request processed in 126us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938108.540014:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784938108.540591:0:8045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8045:1871643144111232:0@lo:502: 00000020:01000000:1.0:1784938108.540616:0:8045:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938108.540622:0:8045:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938108.540624:0:8045:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784938108.540628:0:8045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1784938108.540761:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784938108.540785:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938108.540795:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938108.540805:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938109.535349:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938110.561125:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938110.624446:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938110.624477:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144111360:192.168.203.126@tcp:41: 00000100:00100000:0.0:1784938110.624836:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938110.624983:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144111360 00000100:00100000:1.0:1784938110.625000:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144111360 00000100:00100000:1.0:1784938110.625051:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:1.0:1784938110.625060:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144111360:12345-192.168.203.126@tcp:41: 00000004:00000024:1.0:1784938110.625093:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1784938110.625143:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144111360:12345-192.168.203.126@tcp:41: Request processed in 83us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938110.625151:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:2.0:1784938110.625372:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144111360:192.168.203.126@tcp:41: 00010000:00010000:2.0:1784938111.587300:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938112.163843:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d0190bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144111488:0@lo:400: 00000100:00100000:2.0:1784938112.163939:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938112.163987:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144112000:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938112.164051:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938112.164058:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144111872:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938112.164100:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144111616:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938112.164126:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938112.164132:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d0190ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144111744:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938112.164640:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144111488 00000100:00100000:1.0:1784938112.164648:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144111488 00000100:00100000:1.0:1784938112.164714:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784938112.164723:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:3641:x1871643144111488:12345-0@lo:400: 00000100:00100000:1.0:1784938112.164785:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:3641:x1871643144111488:12345-0@lo:400: Request processed in 63us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938112.164792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784938112.164847:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d0190bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144111488:0@lo:400: 00000100:00100000:2.0:1784938112.165130:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938112.182097:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938112.182148:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938112.182187:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144112000 00000100:00100000:2.0:1784938112.182280:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144112000 00000100:00100000:2.0:1784938112.182326:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144111744 00000100:00100000:2.0:1784938112.182329:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144111744 00000100:00100000:2.0:1784938112.182344:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:2.0:1784938112.182353:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0190b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144112000:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938112.182422:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0190b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144112000:12345-192.168.203.126@tcp:400: Request processed in 69us (17292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938112.182430:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:2.0:1784938112.182447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:2.0:1784938112.182453:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144111744:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938112.182482:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144111744:12345-192.168.203.126@tcp:400: Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938112.182489:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:2.0:1784938112.182505:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144111872 00000100:00100000:2.0:1784938112.182509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144111872 00000100:00100000:2.0:1784938112.182532:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:2.0:1784938112.182537:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0190bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144111872:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938112.182561:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0190bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144111872:12345-192.168.203.126@tcp:400: Request processed in 23us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938112.182567:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:2.0:1784938112.182779:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d0190ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144111744:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938112.187370:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938112.187532:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144111616 00000100:00100000:2.0:1784938112.187540:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144111616 00000100:00100000:2.0:1784938112.187599:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:2.0:1784938112.187608:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144111616:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938112.187670:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144111616:12345-192.168.203.126@tcp:400: Request processed in 63us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938112.187678:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:2.0:1784938112.187821:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938112.187837:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144112128:192.168.203.126@tcp:41: 00010000:00080000:2.0:1784938112.189654:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d01908e00 x1871643144111616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938112.189673:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144111616:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938112.189833:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:1.0:1784938112.190096:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d01908700 x1871643144111872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938112.190109:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144111872:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938112.190123:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144112000:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938112.191307:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144112128 00000100:00100000:2.0:1784938112.191317:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144112128 00000100:00100000:2.0:1784938112.191366:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:2.0:1784938112.191376:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144112128:12345-192.168.203.126@tcp:41: 00000004:00000024:2.0:1784938112.191412:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1784938112.191471:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144112128:12345-192.168.203.126@tcp:41: Request processed in 97us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938112.191478:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:2.0:1784938112.191643:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144112128:192.168.203.126@tcp:41: 00010000:00010000:2.0:1784938112.607514:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938113.631494:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938114.660199:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938115.682155:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938115.743461:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144112256:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938115.745112:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938115.745167:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144112256 00000100:00100000:1.0:1784938115.745175:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144112256 00000100:00100000:1.0:1784938115.745236:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:1.0:1784938115.745246:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0190ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144112256:12345-192.168.203.126@tcp:41: 00000004:00000024:1.0:1784938115.745281:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1784938115.746122:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0190ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144112256:12345-192.168.203.126@tcp:41: Request processed in 874us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938115.746131:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:3.0:1784938115.746339:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144112256:192.168.203.126@tcp:41: 00000020:01000004:2.0:1784938116.562758:0:8422:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:2.0:1784938116.562770:0:8422:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784938116.562772:0:8422:0:(obd_mount.c:925:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1784938116.565501:0:8422:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff910cfd213000 00000020:01000004:2.0:1784938116.565530:0:8422:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784938116.565548:0:8422:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784938116.565568:0:8422:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff910cfcfbcd40) 00000020:00000080:2.0:1784938116.565589:0:8422:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784938116.639727:0:8422:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784938116.639876:0:8422:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:3.0:1784938116.704403:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:0.0:1784938116.704411:0:8422:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784938116.706258:0:8422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1784938116.706280:0:8422:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784938116.706297:0:8422:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26783cd1c59edfe9 00000020:01000004:0.0:1784938116.706307:0:8422:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1784938116.706348:0:8422:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784938116.706353:0:8422:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784938116.706361:0:8422:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1784938116.706368:0:8422:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1784938116.706398:0:8422:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff910cfd760000) 00000020:00000080:0.0:1784938116.706412:0:8422:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1784938116.714379:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938116.714615:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1784938116.714623:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1784938116.715108:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1784938116.715115:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784938116.715296:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784938116.715302:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1784938116.722677:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938116.724103:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1784938116.724131:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784938116.731605:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784938116.731628:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1784938116.806000:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938116.806459:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784938116.806468:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784938116.809390:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784938116.809405:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784938116.810443:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784938116.810452:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784938116.819860:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938116.820098:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784938116.820107:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784938116.823883:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784938116.823902:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1784938116.993682:0:8422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938116.993871:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1784938116.993877:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1784938116.998706:0:8422:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1784938116.998725:0:8422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1784938117.000698:0:8422:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1784938117.000741:0:8422:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1784938117.000750:0:8422:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1784938117.066057:0:8422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784938117.066098:0:8422:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1784938117.066102:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784938117.066104:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784938117.066105:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938117.066106:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938117.066107:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938117.066108:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938117.066110:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938117.066111:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938117.066118:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938117.066119:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938117.066120:0:8422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938117.066123:0:8422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1784938117.066125:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938117.066126:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784938117.066127:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938117.066128:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938117.066129:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938117.066130:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938117.066131:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938117.066131:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938117.066132:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938117.066133:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938117.066134:0:8422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938117.066160:0:8422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784938117.066178:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144112384:0@lo:253: 00000100:00100000:3.0:1784938117.067265:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938117.067682:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144112384 00000100:00100000:2.0:1784938117.067693:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144112384 00000100:00100000:2.0:1784938117.067756:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784938117.067766:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:8422:x1871643144112384:12345-0@lo:253: 20000000:01000000:2.0:1784938117.067806:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784938117.067810:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1784938117.067815:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1784938117.067818:0:6505:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000100:00100000:3.0:1784938117.067969:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf863180 going to sleep for 11 seconds 00000040:00080000:3.0:1784938117.068137:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938117.068314:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1784938117.068328:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1784938117.068342:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1784938117.068348:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1784938117.068358:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1784938117.068370:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1784938117.068644:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1784938117.068660:0:6505:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:3.0:1784938117.068662:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1784938117.068673:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1784938117.068678:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784938117.068703:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1784938117.068708:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1784938117.068718:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1784938117.068724:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784938117.068740:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1784938117.068752:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1784938117.068810:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1784938117.068818:0:6505:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:3.0:1784938117.068820:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1784938117.068846:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1784938117.068852:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784938117.068864:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1784938117.068868:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1784938117.068878:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1784938117.068883:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784938117.068892:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1784938117.068904:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1784938117.070505:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1784938117.070531:0:6505:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:3.0:1784938117.070533:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1784938117.070548:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1784938117.070555:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784938117.070566:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1784938117.070570:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1784938117.070580:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1784938117.070585:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784938117.070595:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1784938117.070608:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1784938117.070620:0:6505:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784938117.070623:0:6505:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784938117.070626:0:6505:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784938117.070664:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784938117.070666:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784938117.072486:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1784938117.072535:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1784938117.072563:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1784938117.072805:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1784938117.072840:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1784938117.072857:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1784938117.072867:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784938117.072869:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784938117.073255:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1784938117.073278:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1784938117.073309:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1784938117.073549:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1784938117.073569:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1784938117.073584:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1784938117.073593:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1784938117.073596:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784938117.078286:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1784938117.078356:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1784938117.078377:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1784938117.078748:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1784938117.078774:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1784938117.078789:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1784938117.078799:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784938117.078802:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784938117.082080:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1784938117.083534:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1784938117.083568:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1784938117.083582:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1784938117.083601:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784938117.083623:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083641:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cc0031e00/0x26783cd1c59edec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edebc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083649:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d020d0600/0x26783cd1c59edf3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf33 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083656:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cd9247e00/0x26783cd1c59edf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf6b expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083662:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b76200/0x26783cd1c59edf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf87 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083668:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d020d1400/0x26783cd1c59edfb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edfb1 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083676:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083716:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d020d1400/0x26783cd1c59edfb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edfb1 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083731:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d020d1400/0x26783cd1c59edfb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edfb1 expref: 18 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.083746:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144112512:0@lo:104: 00000100:00100000:0.0:1784938117.083834:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938117.083891:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b76200/0x26783cd1c59edf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edf87 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083899:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910ce6b76200/0x26783cd1c59edf8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edf87 expref: 18 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.083908:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144112640:0@lo:104: 00000100:00100000:0.0:1784938117.083928:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938117.083948:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cd9247e00/0x26783cd1c59edf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edf6b expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.083956:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cd9247e00/0x26783cd1c59edf72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edf6b expref: 18 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.083963:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144112768:0@lo:104: 00000100:00100000:0.0:1784938117.084003:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938117.084022:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d020d0600/0x26783cd1c59edf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edf33 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.084030:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d020d0600/0x26783cd1c59edf3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edf33 expref: 18 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.084037:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144112896:0@lo:104: 00000100:00100000:0.0:1784938117.084056:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938117.084072:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cc0031e00/0x26783cd1c59edec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edebc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.084080:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cc0031e00/0x26783cd1c59edec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edebc expref: 18 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.084102:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4837b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144113024:0@lo:104: 00000100:00100000:0.0:1784938117.084132:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938117.084145:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc17783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938117.084244:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144112512 00000100:00100000:3.0:1784938117.084251:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144112512 00000100:00100000:3.0:1784938117.084287:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144112640 00000100:00100000:3.0:1784938117.084290:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144112640 00000100:00100000:3.0:1784938117.084300:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144112768 00000100:00100000:3.0:1784938117.084302:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144112768 00000100:00100000:3.0:1784938117.084310:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144112896 00000100:00100000:3.0:1784938117.084312:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144112896 00000100:00100000:3.0:1784938117.084320:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144113024 00000100:00100000:3.0:1784938117.084322:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144113024 00000100:00100000:3.0:1784938117.084334:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938117.084342:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+7:6505:x1871643144112512:12345-0@lo:104: 00010000:00010000:3.0:1784938117.084356:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59edfb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084417:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938117.084424:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+7:6505:x1871643144112512:12345-0@lo:104: Request processed in 82us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.084431:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938117.084448:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938117.084461:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+6:6505:x1871643144112640:12345-0@lo:104: 00010000:00010000:3.0:1784938117.084469:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cc0030000/0x26783cd1c59edf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084502:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784938117.084507:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+6:6505:x1871643144112640:12345-0@lo:104: Request processed in 48us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.084513:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938117.084526:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938117.084532:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+5:6505:x1871643144112768:12345-0@lo:104: 00010000:00010000:3.0:1784938117.084539:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cd9246e00/0x26783cd1c59edf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084571:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784938117.084576:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+5:6505:x1871643144112768:12345-0@lo:104: Request processed in 45us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.084582:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938117.084592:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784938117.084597:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6505:x1871643144112896:12345-0@lo:104: 00010000:00010000:3.0:1784938117.084605:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59edf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084628:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784938117.084633:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6505:x1871643144112896:12345-0@lo:104: Request processed in 36us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.084638:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784938117.084648:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938117.084653:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6505:x1871643144113024:12345-0@lo:104: 00010000:00010000:3.0:1784938117.084666:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cc0030600/0x26783cd1c59edebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084693:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784938117.084697:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6505:x1871643144113024:12345-0@lo:104: Request processed in 45us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.084702:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1784938117.084720:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784938117.084725:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59edfb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084731:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77600 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938117.084735:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59edfb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084743:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59edfb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938117.084750:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59edfb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938117.084756:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938117.084784:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59edfb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084790:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938117.084805:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59edfb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084811:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59edfb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edfb8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084842:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938117.084845:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cc0030000/0x26783cd1c59edf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084850:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc0030000 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938117.084853:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030000/0x26783cd1c59edf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084860:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cc0030000/0x26783cd1c59edf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938117.084866:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030000/0x26783cd1c59edf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938117.084871:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938117.084884:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cc0030000/0x26783cd1c59edf87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084890:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938117.084896:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cc0030000/0x26783cd1c59edf87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084902:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cc0030000/0x26783cd1c59edf87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf8e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084912:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938117.084915:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cd9246e00/0x26783cd1c59edf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084930:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9246e00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938117.084933:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cd9246e00/0x26783cd1c59edf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084939:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cd9246e00/0x26783cd1c59edf6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938117.084944:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cd9246e00/0x26783cd1c59edf6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938117.084948:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938117.084962:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cd9246e00/0x26783cd1c59edf6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084967:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938117.084980:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cd9246e00/0x26783cd1c59edf6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084986:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cd9246e00/0x26783cd1c59edf6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.084994:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938117.084997:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59edf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085003:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938117.085005:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59edf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085022:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59edf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938117.085028:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59edf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938117.085033:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938117.085045:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59edf33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085050:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938117.085054:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59edf33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085060:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59edf33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf3a expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085070:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938117.085073:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cc0030600/0x26783cd1c59edebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085079:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc0030600 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938117.085081:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030600/0x26783cd1c59edebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085087:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cc0030600/0x26783cd1c59edebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938117.085093:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030600/0x26783cd1c59edebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938117.085103:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938117.085115:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cc0030600/0x26783cd1c59edebc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085120:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938117.085125:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cc0030600/0x26783cd1c59edebc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085130:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cc0030600/0x26783cd1c59edebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edec3 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085142:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938117.085143:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938117.085145:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938117.085165:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144113536:0@lo:103: 00000100:00100000:3.0:1784938117.085197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.085243:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938117.085250:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144113408:0@lo:103: 00000100:00100000:3.0:1784938117.085272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.085299:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144113536 00000100:00100000:3.0:1784938117.085304:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144113536 00010000:00010000:3.0:1784938117.085324:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d020d0600/0x26783cd1c59edf3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf33 expref: 19 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.085342:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144113408 00000100:00100000:3.0:1784938117.085345:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144113408 00010000:00010000:3.0:1784938117.085369:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cd9247e00/0x26783cd1c59edf72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf6b expref: 20 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.085396:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938117.085403:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+20:3643:x1871643144113536:12345-0@lo:103: 00010000:00010000:3.0:1784938117.085414:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938117.085419:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d020d0600/0x26783cd1c59edf3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf33 expref: 20 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085428:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d020d0600/0x26783cd1c59edf3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edf33 expref: 20 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085442:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938117.085471:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+20:3643:x1871643144113536:12345-0@lo:103: Request processed in 68us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.085477:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938117.085491:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938117.085496:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+19:3643:x1871643144113408:12345-0@lo:103: 00010000:00010000:3.0:1784938117.085504:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938117.085508:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cd9247e00/0x26783cd1c59edf72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf6b expref: 19 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085516:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cd9247e00/0x26783cd1c59edf72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edf6b expref: 19 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.085526:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938117.085547:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+19:3643:x1871643144113408:12345-0@lo:103: Request processed in 51us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.085553:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938117.085583:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144113408:0@lo:103: 00000100:00100000:3.0:1784938117.085604:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144113536:0@lo:103: 00010000:00010000:2.0:1784938117.085687:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938117.085700:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144113152:0@lo:103: 00000100:00100000:2.0:1784938117.085727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938117.085750:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144113664:0@lo:103: 00000100:00100000:2.0:1784938117.085772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938117.085794:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938117.085799:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144113280:0@lo:103: 00000100:00100000:2.0:1784938117.085820:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.085988:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144113152 00000100:00100000:3.0:1784938117.085992:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144113152 00010000:00010000:3.0:1784938117.086008:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d020d1400/0x26783cd1c59edfb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edfb1 expref: 19 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.086021:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144113664 00000100:00100000:3.0:1784938117.086023:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144113664 00010000:00010000:3.0:1784938117.086033:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cc0031e00/0x26783cd1c59edec3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edebc expref: 20 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.086042:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144113280 00000100:00100000:3.0:1784938117.086045:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144113280 00010000:00010000:3.0:1784938117.086053:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b76200/0x26783cd1c59edf8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf87 expref: 21 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.086064:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938117.086069:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3640:x1871643144113152:12345-0@lo:103: 00010000:00010000:3.0:1784938117.086077:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938117.086081:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d020d1400/0x26783cd1c59edfb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edfb1 expref: 21 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086089:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d020d1400/0x26783cd1c59edfb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edfb1 expref: 21 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086099:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938117.086235:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784938117.086262:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3640:x1871643144113664:12345-0@lo:103: 00010000:00010000:1.0:1784938117.086271:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938117.086276:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cc0031e00/0x26783cd1c59edec3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edebc expref: 21 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.086284:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cc0031e00/0x26783cd1c59edec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edebc expref: 21 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.086294:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938117.086354:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3640:x1871643144113152:12345-0@lo:103: Request processed in 283us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.086361:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938117.086376:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938117.086390:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+20:3640:x1871643144113280:12345-0@lo:103: 00010000:00010000:3.0:1784938117.086398:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938117.086403:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b76200/0x26783cd1c59edf8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf87 expref: 20 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086411:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b76200/0x26783cd1c59edf8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edf87 expref: 20 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086423:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086432:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086446:0:7921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086454:0:7921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086460:0:7921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086467:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086472:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938117.086476:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086483:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086498:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.086508:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938117.086696:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938117.086725:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d1400/0x26783cd1c59edfb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edfb1 expref: 20 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.086738:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144112512:0@lo:104: 00010000:00010000:0.0:1784938117.086748:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76200/0x26783cd1c59edf8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edf87 expref: 19 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.086755:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144112640:0@lo:104: 00010000:00010000:0.0:1784938117.086764:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9247e00/0x26783cd1c59edf72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edf6b expref: 18 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.086771:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144112768:0@lo:104: 00010000:00010000:0.0:1784938117.086779:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d0600/0x26783cd1c59edf3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edf33 expref: 17 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.086786:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144112896:0@lo:104: 00010000:00010000:0.0:1784938117.086794:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc0031e00/0x26783cd1c59edec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edebc expref: 16 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.086801:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4837b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1871643144113024:0@lo:104: 00010000:00010000:0.0:1784938117.086839:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.086859:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.086865:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.086871:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77000/0x26783cd1c59edff7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784938117.086885:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784938117.094270:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144112384:12345-0@lo:253: Request processed in 26491us (27966us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938117.094289:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784938117.095056:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:3640:x1871643144113664:12345-0@lo:103: Request processed in 8784us (9270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938117.095072:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784938117.095280:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144113152:0@lo:103: 00000100:00100000:2.0:1784938117.095293:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144113664:0@lo:103: 00000100:00100000:3.0:1784938117.100773:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+13:3640:x1871643144113280:12345-0@lo:103: Request processed in 14373us (14940us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.100787:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938117.101100:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144112384:0@lo:253: 10000000:01000000:3.0:1784938117.101116:0:8422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784938117.101119:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938117.101121:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784938117.101122:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938117.101123:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1784938117.101124:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938117.101126:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938117.101127:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938117.101129:0:8422:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784938117.101130:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938117.101131:0:8422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784938117.101155:0:8422:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910cfd213000 from lustre-OST0000 10000000:01000000:3.0:1784938117.101182:0:8422:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784938117.101185:0:8422:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784938117.101192:0:8422:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910cf3bf8000 local copy 10000000:01000000:3.0:1784938117.101196:0:8422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784938117.101287:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.101297:0:8422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.101306:0:8422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.101336:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144113792:0@lo:101: 00000100:00100000:3.0:1784938117.101392:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.101472:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938117.101936:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144113280:0@lo:103: 00000100:00100000:1.0:1784938117.111652:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144113792 00000100:00100000:1.0:1784938117.111667:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144113792 00000100:00100000:1.0:1784938117.111736:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784938117.111747:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+13:8422:x1871643144113792:12345-0@lo:101: 00010000:00010000:1.0:1784938117.111764:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938117.111782:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ee005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59edffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.111807:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ee005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59edffe expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.111819:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ee005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edffe expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.111841:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0600, rc 0) 00000100:00100000:1.0:1784938117.111925:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144113792:12345-0@lo:101: Request processed in 180us (10532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938117.111948:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784938117.112067:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144113792:0@lo:101: 00010000:00010000:3.0:1784938117.112085:0:8422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.112094:0:8422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.112198:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144113920:0@lo:501: 00000100:00100000:3.0:1784938117.112269:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.112301:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938117.112358:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144113920 00000100:00100000:2.0:1784938117.112363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144113920 00000100:00100000:2.0:1784938117.112388:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784938117.112395:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144113920:12345-0@lo:501: 00000100:00100000:2.0:1784938117.112465:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144113920:12345-0@lo:501: Request processed in 70us (194us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938117.112471:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784938117.112532:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144113920:0@lo:501: 10000000:01000000:3.0:1784938117.112544:0:8422:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784938117.112560:0:8422:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784938117.112566:0:8422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.112574:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.112582:0:8422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.112610:0:8422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784938117.112642:0:8422:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910cfd213000 10000000:01000000:3.0:1784938117.112646:0:8422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784938117.112651:0:8422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784938117.112654:0:8422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938117.112658:0:8422:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784938117.112661:0:8422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938117.112679:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.112687:0:8422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.112697:0:8422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.112709:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114048:0@lo:101: 00000100:00100000:3.0:1784938117.112735:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.112747:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938117.112790:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144114048 00000100:00100000:2.0:1784938117.112794:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144114048 00000100:00100000:2.0:1784938117.112811:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784938117.112818:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144114048:12345-0@lo:101: 00010000:00010000:2.0:1784938117.112836:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938117.112845:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee00c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.112858:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee00c expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.112865:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee00c expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.112881:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d0400, rc 0) 00000100:00100000:2.0:1784938117.112921:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144114048:12345-0@lo:101: Request processed in 104us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.112927:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:2.0:1784938117.112951:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938117.112957:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.112964:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215bc00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938117.112968:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.112977:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938117.112984:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938117.112990:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938117.113008:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.113014:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938117.113031:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.113039:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59edffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26783cd1c59ee005 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.113063:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938117.113065:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938117.113067:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938117.113078:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144114176:0@lo:103: 00000100:00100000:2.0:1784938117.113106:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.113185:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114048:0@lo:101: 00010000:00010000:3.0:1784938117.113195:0:8422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.113203:0:8422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.113285:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114304:0@lo:501: 00000100:00100000:3.0:1784938117.113311:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.113328:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938117.113397:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144114304 00000100:00100000:1.0:1784938117.113403:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144114304 00000100:00100000:1.0:1784938117.113436:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784938117.113443:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144114176 00000100:00100000:1.0:1784938117.113445:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144114304:12345-0@lo:501: 00000100:00100000:0.0:1784938117.113459:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144114176 00000100:00100000:0.0:1784938117.113552:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784938117.113569:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:3641:x1871643144114176:12345-0@lo:103: 00000100:00100000:1.0:1784938117.113579:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144114304:12345-0@lo:501: Request processed in 129us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938117.113589:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1784938117.113592:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938117.113618:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ee005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59edffe expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.113639:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938117.113697:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114304:0@lo:501: 00000100:00100000:0.0:1784938117.113724:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:3641:x1871643144114176:12345-0@lo:103: Request processed in 158us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938117.113736:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938117.113764:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114432:0@lo:503: 00000100:00100000:3.0:1784938117.113814:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.113856:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938117.113941:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144114432 00000100:00100000:2.0:1784938117.113947:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144114432 00000100:00100000:2.0:1784938117.113976:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784938117.113983:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144114432:12345-0@lo:503: 00000100:00100000:2.0:1784938117.114064:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144114432:12345-0@lo:503: Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.114071:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784938117.114158:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144114176:0@lo:103: 00000100:00100000:3.0:1784938117.114428:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114432:0@lo:503: 00000040:00080000:3.0:1784938117.114710:0:8422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938117.114780:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114560:0@lo:502: 00000100:00100000:3.0:1784938117.114821:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.114864:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938117.114971:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144114560 00000100:00100000:2.0:1784938117.114976:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144114560 00000100:00100000:2.0:1784938117.115011:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784938117.115019:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144114560:12345-0@lo:502: 00000100:00100000:2.0:1784938117.115107:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144114560:12345-0@lo:502: Request processed in 88us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.115115:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784938117.115253:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114560:0@lo:502: 00000040:00080000:3.0:1784938117.115419:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784938117.115446:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784938117.115460:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784938117.115473:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784938117.115484:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784938117.115496:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784938117.115527:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114688:0@lo:502: 00000100:00100000:3.0:1784938117.115561:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.115579:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938117.115681:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144114688 00000100:00100000:0.0:1784938117.115687:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144114688 00000100:00100000:0.0:1784938117.115718:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784938117.115726:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144114688:12345-0@lo:502: 00000100:00100000:0.0:1784938117.115816:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144114688:12345-0@lo:502: Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938117.115833:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784938117.115937:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114688:0@lo:502: 00000040:00080000:3.0:1784938117.115973:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784938117.115982:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784938117.125411:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784938117.125425:0:8445:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1784938117.125432:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938117.125434:0:8445:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784938117.125444:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938117.125461:0:8445:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff910cf3bf99c0) 00000020:00000080:3.0:1784938117.125501:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784938117.125510:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784938117.125605:0:8445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cfd213000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784938117.125614:0:8445:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784938117.125628:0:8445:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26783cd1c59ee021 00010000:00010000:3.0:1784938117.136534:0:8445:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1784938117.147911:0:8445:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1784938117.160778:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784938117.161130:0:8445:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1784938117.170715:0:8445:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1784938117.171131:0:8445:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1784938117.184628:0:8445:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1784938117.187955:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784938117.187969:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938117.187976:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938117.187978:0:8445:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784938117.187982:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938117.187985:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938117.187987:0:8445:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938117.187990:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938117.187992:0:8445:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784938117.188018:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938117.188020:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938117.188022:0:8445:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784938117.188024:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784938117.188405:0:8422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1784938117.188434:0:8422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784938117.188511:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.188524:0:8422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938117.188532:0:8422:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cfd213000 from 1 10000000:01000000:3.0:1784938117.188535:0:8422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938117.188568:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.188576:0:8422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.188587:0:8422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.188607:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114816:0@lo:101: 00000100:00100000:3.0:1784938117.188679:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.188723:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef3676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938117.188784:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144114816 00000100:00100000:1.0:1784938117.188791:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144114816 00000100:00100000:1.0:1784938117.188840:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784938117.188849:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+14:8422:x1871643144114816:12345-0@lo:101: 00010000:00010000:1.0:1784938117.188861:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938117.188873:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee028 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.188894:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee028 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.188904:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee028 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.188912:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0400, rc 0) 00000100:00100000:1.0:1784938117.188952:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144114816:12345-0@lo:101: Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938117.188958:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784938117.189082:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114816:0@lo:101: 00010000:00010000:3.0:1784938117.189095:0:8422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.189103:0:8422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.189179:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114944:0@lo:501: 00000100:00100000:3.0:1784938117.189201:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.189251:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef3676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938117.190279:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144114944 00000100:00100000:3.0:1784938117.190287:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144114944 00000100:00100000:3.0:1784938117.190339:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784938117.190346:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144114944:12345-0@lo:501: 00000100:00100000:3.0:1784938117.191420:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144114944:12345-0@lo:501: Request processed in 1068us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.191430:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784938117.194019:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144114944:0@lo:501: 00000100:00100000:1.0:1784938117.194075:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115072:0@lo:503: 00000100:00100000:1.0:1784938117.194141:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938117.194181:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc5f1ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938117.194308:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144115072 00000100:00100000:2.0:1784938117.194314:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144115072 00000100:00100000:2.0:1784938117.194363:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784938117.194371:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144115072:12345-0@lo:503: 00000100:00100000:2.0:1784938117.194481:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144115072:12345-0@lo:503: Request processed in 110us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.194488:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784938117.194610:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115072:0@lo:503: 00000040:00080000:1.0:1784938117.194883:0:8422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938117.194959:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115200:0@lo:502: 00000100:00100000:1.0:1784938117.194999:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938117.195036:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1587f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938117.195096:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144115200 00000100:00100000:2.0:1784938117.195101:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144115200 00000100:00100000:2.0:1784938117.195133:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784938117.195140:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144115200:12345-0@lo:502: 00000100:00100000:2.0:1784938117.195494:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144115200:12345-0@lo:502: Request processed in 353us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.195501:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784938117.199119:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115200:0@lo:502: 00000040:00080000:0.0:1784938117.199632:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784938117.199664:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784938117.199703:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115328:0@lo:502: 00000100:00100000:0.0:1784938117.199779:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938117.199820:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938117.199931:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144115328 00000100:00100000:3.0:1784938117.199938:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144115328 00000100:00100000:3.0:1784938117.199986:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784938117.199994:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144115328:12345-0@lo:502: 00000100:00100000:3.0:1784938117.200111:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144115328:12345-0@lo:502: Request processed in 117us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.200119:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784938117.200204:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115328:0@lo:502: 00000040:00080000:0.0:1784938117.200273:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784938117.200281:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1784938117.201126:0:8449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938117.201136:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938117.201138:0:8449:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784938117.201144:0:8449:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cfd213000 00000020:00000080:1.0:1784938117.201146:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938117.201156:0:8449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938117.201158:0:8449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938117.201160:0:8449:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784938117.201162:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1784938117.201373:0:8422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784938117.201398:0:8422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938117.201415:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.201436:0:8422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938117.201490:0:8422:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784938117.201493:0:8422:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910cfd213000 10000000:01000000:0.0:1784938117.201496:0:8422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910cfd213000 10000000:01000000:0.0:1784938117.201501:0:8422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938117.201507:0:8422:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cfd213000 from 1 10000000:01000000:0.0:1784938117.201510:0:8422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784938117.201545:0:8422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.201554:0:8422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.201565:0:8422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.201584:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115456:0@lo:101: 00000100:00100000:0.0:1784938117.201636:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938117.201811:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938117.201877:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144115456 00000100:00100000:2.0:1784938117.201884:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144115456 00000100:00100000:2.0:1784938117.201952:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784938117.201962:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8422:x1871643144115456:12345-0@lo:101: 00010000:00010000:2.0:1784938117.201975:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938117.201988:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee036 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.202010:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee036 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.202019:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee036 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938117.202028:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1000, rc 0) 00000100:00100000:2.0:1784938117.202075:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144115456:12345-0@lo:101: Request processed in 115us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.202081:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784938117.202146:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115456:0@lo:101: 00010000:00010000:0.0:1784938117.202160:0:8422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.202170:0:8422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.202286:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115584:0@lo:501: 00000100:00100000:0.0:1784938117.202327:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938117.202655:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938117.202729:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144115584 00000100:00100000:3.0:1784938117.202734:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144115584 00000100:00100000:3.0:1784938117.202779:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784938117.202786:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144115584:12345-0@lo:501: 00000100:00100000:3.0:1784938117.202923:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144115584:12345-0@lo:501: Request processed in 137us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.202930:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784938117.203025:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115584:0@lo:501: 00000100:00100000:0.0:1784938117.203052:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115712:0@lo:503: 00000100:00100000:0.0:1784938117.203097:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938117.203113:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938117.203211:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144115712 00000100:00100000:3.0:1784938117.203240:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144115712 00000100:00100000:3.0:1784938117.203262:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784938117.203267:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144115712:12345-0@lo:503: 00000100:00100000:3.0:1784938117.203343:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144115712:12345-0@lo:503: Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.203349:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784938117.203518:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115712:0@lo:503: 00000040:00080000:0.0:1784938117.203746:0:8422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784938117.203806:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115840:0@lo:502: 00000100:00100000:0.0:1784938117.203854:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938117.203872:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938117.203946:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144115840 00000100:00100000:3.0:1784938117.203950:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144115840 00000100:00100000:3.0:1784938117.203976:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784938117.203982:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144115840:12345-0@lo:502: 00000100:00100000:3.0:1784938117.204056:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144115840:12345-0@lo:502: Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.204063:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784938117.204190:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115840:0@lo:502: 00000040:00080000:0.0:1784938117.204505:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784938117.204531:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784938117.204546:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784938117.204558:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784938117.204570:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784938117.204582:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784938117.204594:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784938117.204604:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784938117.204616:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784938117.204628:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784938117.204640:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784938117.204652:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784938117.204664:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784938117.204688:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784938117.204700:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784938117.204806:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784938117.204981:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784938117.204998:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784938117.205012:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784938117.205025:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784938117.205039:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784938117.205053:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784938117.205066:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784938117.205079:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784938117.205091:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1784938117.205101:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1784938117.205111:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1784938117.205122:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1784938117.205133:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1784938117.205142:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1784938117.205152:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1784938117.205162:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1784938117.205171:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1784938117.205181:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1784938117.205193:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1784938117.205206:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1784938117.205623:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1784938117.205657:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115968:0@lo:502: 00000100:00100000:0.0:1784938117.205715:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938117.205788:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938117.208511:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144115968 00000100:00100000:3.0:1784938117.208527:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144115968 00000100:00100000:0.0:1784938117.215141:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784938117.215153:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144115968:12345-0@lo:502: 00000100:00100000:0.0:1784938117.215352:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144115968:12345-0@lo:502: Request processed in 200us (9636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938117.215370:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784938117.215519:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144115968:0@lo:502: 00000040:00080000:1.0:1784938117.215602:0:8422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1784938117.215617:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1784938117.216761:0:8450:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784938117.216779:0:8450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff910cfcfb99c0) 00000020:00000080:2.0:1784938117.216814:0:8450:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1784938117.217014:0:8450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cfd213000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784938117.217024:0:8450:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cfd213000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784938117.217027:0:8450:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cfd213000 3 00010000:00080000:2.0:1784938117.217058:0:8450:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc1755800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1784938117.219334:0:8450:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1784938117.219439:0:8450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784938117.219487:0:8450:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784938117.219501:0:8450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x26783cd1c59ee04b 00000100:00080000:2.0:1784938117.219513:0:8450:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:2.0:1784938117.219524:0:8450:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff910bc1755800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938117.219560:0:8450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d01909180 x1871643144116096/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938117.219583:0:8450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784938117.221589:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1871643144116096:192.168.203.126@tcp:38: 00000100:00100000:3.0:1784938117.221772:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144116224:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938117.221815:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938117.221834:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144116352:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938117.221874:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144116480:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938117.221911:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938117.221917:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144116608:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938117.222098:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938117.222134:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938117.222239:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938117.222267:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938117.222292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938117.222319:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144116096 00000100:00100000:3.0:1784938117.222325:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144116096 00000100:00100000:3.0:1784938117.222349:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144116480 00000100:00100000:3.0:1784938117.222351:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144116480 00000100:00100000:3.0:1784938117.222370:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144116224 00000100:00100000:3.0:1784938117.222373:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144116224 00000100:00100000:3.0:1784938117.222388:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:3.0:1784938117.222397:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144116480:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938117.222444:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144116480:12345-192.168.203.126@tcp:400: Request processed in 48us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.222451:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:3.0:1784938117.222468:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:3.0:1784938117.222474:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144116224:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938117.222501:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144116224:12345-192.168.203.126@tcp:400: Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.222507:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:3.0:1784938117.222519:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938117.222523:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1871643144116096:12345-192.168.203.126@tcp:38: 00010000:00080000:3.0:1784938117.222544:0:6513:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1784938117.222583:0:6513:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x26783cd1c59ee052 00000004:00100000:3.0:1784938117.222595:0:6513:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784938117.222627:0:6513:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938117.222655:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871643144116096:12345-192.168.203.126@tcp:38: Request processed in 130us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.222661:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938117.222684:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144116352 00000100:00100000:3.0:1784938117.222687:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144116352 00000100:00100000:3.0:1784938117.222707:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144116608 00000100:00100000:3.0:1784938117.222709:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144116608 00000100:00100000:3.0:1784938117.222720:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:3.0:1784938117.222725:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144116352:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938117.222749:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144116352:12345-192.168.203.126@tcp:400: Request processed in 24us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.222755:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:3.0:1784938117.222765:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00100000:3.0:1784938117.222770:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144116608:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938117.222788:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144116608:12345-192.168.203.126@tcp:400: Request processed in 18us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.222792:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00100000:3.0:1784938117.222995:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144116608:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938117.223010:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cfb2d7b80 x1871643144116480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938117.223021:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144116480:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938117.223050:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d01909180 x1871643144116096/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938117.223066:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938117.223073:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1784938117.223080:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784938117.223085:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784938117.223087:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc1755800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784938117.223093:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1871643144116096:192.168.203.126@tcp:38: 00000100:00100000:3.0:1784938117.223121:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144116352:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938117.223131:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cfb2d4e00 x1871643144116224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938117.223139:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144116224:192.168.203.126@tcp:400: 00000020:01000004:3.0:1784938117.227096:0:8450:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784938117.227116:0:8450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff910cf3bfb380) 00000020:00000080:3.0:1784938117.227141:0:8450:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1784938117.227362:0:8450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cfd213000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784938117.227367:0:8450:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cfd213000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784938117.227369:0:8450:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cfd213000 3 00010000:00080000:3.0:1784938117.227404:0:8450:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc58d3000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1784938117.237380:0:8450:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1784938117.237488:0:8450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1784938117.237533:0:8450:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938117.237545:0:8450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x26783cd1c59ee060 00000100:00080000:3.0:1784938117.237557:0:8450:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:3.0:1784938117.237569:0:8450:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff910bc58d3000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938117.237605:0:8450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cfb2d4e00 x1871643144116736/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938117.237640:0:8450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784938117.237929:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1871643144116736:192.168.203.126@tcp:38: 00000100:00100000:3.0:1784938117.240090:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000040:00080000:3.0:1784938117.240205:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1784938117.241079:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144116736 00000100:00100000:1.0:1784938117.241090:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144116736 00000100:00100000:1.0:1784938117.241134:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:1.0:1784938117.241142:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1871643144116736:12345-192.168.203.126@tcp:38: 00010000:00080000:1.0:1784938117.241170:0:6513:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1784938117.241204:0:6513:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x26783cd1c59ee067 00000004:00100000:1.0:1784938117.241243:0:6513:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784938117.241280:0:6513:0:(import.c:65:import_set_state_nolock()) ffff910bc5b29000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938117.241339:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871643144116736:12345-192.168.203.126@tcp:38: Request processed in 196us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938117.241346:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00000020:01000000:1.0:1784938117.241369:0:8422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1784938117.241404:0:8422:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938117.241416:0:8422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.241426:0:8422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784938117.241478:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784938117.241480:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938117.241481:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938117.241482:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938117.241484:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938117.241485:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938117.241487:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938117.241488:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784938117.241489:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784938117.241491:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938117.241493:0:8422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784938117.241497:0:8422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1784938117.241499:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938117.241501:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938117.241502:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938117.241503:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938117.241504:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938117.241504:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938117.241505:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938117.241506:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784938117.241507:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784938117.241508:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938117.241514:0:8422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784938117.241535:0:8422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784938117.241551:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144116864:0@lo:253: 00000100:00100000:1.0:1784938117.241603:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938117.241635:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf8583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938117.241768:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144116864 00000100:00100000:1.0:1784938117.241772:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144116864 00000100:00100000:1.0:1784938117.241801:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784938117.241808:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144116864:12345-0@lo:253: 20000000:01000000:1.0:1784938117.242186:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784938117.242201:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1784938117.242371:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cfb2d4e00 x1871643144116736/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938117.242382:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938117.242390:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1784938117.242396:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784938117.242402:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784938117.242405:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc58d3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784938117.242412:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1871643144116736:192.168.203.126@tcp:38: 20000000:01000000:1.0:1784938117.265283:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938117.265399:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784938117.273637:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:8422:x1871643144116864:12345-0@lo:253: Request processed in 31821us (32025us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938117.273652:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784938117.273760:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:8422:1871643144116864:0@lo:253: 10000000:01000000:2.0:1784938117.273775:0:8422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784938117.273778:0:8422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938117.273780:0:8422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784938117.273791:0:8422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938117.273793:0:8422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938117.273794:0:8422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938117.273796:0:8422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938117.273797:0:8422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938117.273798:0:8422:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938117.273800:0:8422:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938117.273802:0:8422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938117.273803:0:8422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784938117.273817:0:8422:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1784938117.276950:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784938117.276961:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784938117.276989:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.277007:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d0215b800/0x26783cd1c59edf64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf5d expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.277014:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cd9246200/0x26783cd1c59edf80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edf79 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.277022:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.277064:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cd9246200/0x26783cd1c59edf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edf79 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.277080:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cd9246200/0x26783cd1c59edf80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edf79 expref: 15 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.277094:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144116992:0@lo:104: 00000100:00100000:3.0:1784938117.277162:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784938117.277238:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d0215b800/0x26783cd1c59edf64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edf5d expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938117.277247:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d0215b800/0x26783cd1c59edf64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edf5d expref: 15 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.277270:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144117120:0@lo:104: 00000100:00100000:3.0:1784938117.277304:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938117.277483:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784938117.277502:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938117.277531:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144116992 00000100:00100000:1.0:1784938117.277538:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144116992 00000100:00100000:1.0:1784938117.277577:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144117120 00000100:00100000:1.0:1784938117.277581:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144117120 00000100:00100000:1.0:1784938117.277596:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784938117.277605:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd2b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6528:x1871643144116992:12345-0@lo:104: 00010000:00010000:1.0:1784938117.277617:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cc0030200/0x26783cd1c59edf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277681:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938117.277686:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd2b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6528:x1871643144116992:12345-0@lo:104: Request processed in 83us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938117.277693:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784938117.277740:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784938117.277746:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6528:x1871643144117120:12345-0@lo:104: 00010000:00010000:1.0:1784938117.277752:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59edf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277792:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784938117.277797:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6528:x1871643144117120:12345-0@lo:104: Request processed in 52us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938117.277802:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1784938117.277819:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938117.277836:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cc0030200/0x26783cd1c59edf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277843:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc0030200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:1.0:1784938117.277847:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030200/0x26783cd1c59edf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277854:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cc0030200/0x26783cd1c59edf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938117.277868:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030200/0x26783cd1c59edf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938117.277874:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938117.277901:0:7463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cc0030200/0x26783cd1c59edf79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277908:0:7463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938117.277921:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cc0030200/0x26783cd1c59edf79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277928:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cc0030200/0x26783cd1c59edf79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf80 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277940:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938117.277942:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59edf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277947:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc0030a00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:1.0:1784938117.277949:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59edf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277955:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59edf5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938117.277960:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59edf5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938117.277965:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938117.277984:0:7463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59edf5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.277990:0:7463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938117.277994:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59edf5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.278001:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59edf5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edf64 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938117.278012:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938117.278013:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938117.278015:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938117.278021:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938117.278078:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144116992:0@lo:104: 00000100:00100000:0.0:1784938117.278087:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144117120:0@lo:104: 00010000:00010000:0.0:1784938117.278105:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.278580:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144117248:0@lo:103: 00000100:00100000:3.0:1784938117.278619:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.278654:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938117.278661:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144117376:0@lo:103: 00000100:00100000:3.0:1784938117.278680:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938117.278870:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144117248 00000100:00100000:0.0:1784938117.278876:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144117248 00010000:00010000:0.0:1784938117.278903:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cd9246200/0x26783cd1c59edf80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf79 expref: 16 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.278933:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144117376 00000100:00100000:0.0:1784938117.278936:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144117376 00010000:00010000:0.0:1784938117.278947:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d0215b800/0x26783cd1c59edf64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf5d expref: 17 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938117.278962:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784938117.278968:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+17:3642:x1871643144117248:12345-0@lo:103: 00010000:00010000:0.0:1784938117.278979:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938117.278983:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cd9246200/0x26783cd1c59edf80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf79 expref: 17 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.278992:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cd9246200/0x26783cd1c59edf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edf79 expref: 17 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279006:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9246200/0x26783cd1c59edf80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edf79 expref: 17 pid: 6507 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279034:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938117.279064:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+16:3642:x1871643144117248:12345-0@lo:103: Request processed in 96us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938117.279071:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784938117.279088:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784938117.279094:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+15:3642:x1871643144117376:12345-0@lo:103: 00010000:00010000:0.0:1784938117.279101:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938117.279105:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d0215b800/0x26783cd1c59edf64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edf5d expref: 15 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279114:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d0215b800/0x26783cd1c59edf64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edf5d expref: 15 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279123:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d0215b800/0x26783cd1c59edf64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edf5d expref: 15 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279134:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279142:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784938117.279155:0:7921:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012153715s 00010000:00010000:0.0:1784938117.279160:0:7921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279166:0:7921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279183:0:7921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279190:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279196:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215bc00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938117.279201:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279210:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279261:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279271:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938117.279565:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144117248:0@lo:103: 00000100:00100000:0.0:1784938117.279680:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+14:3642:x1871643144117376:12345-0@lo:103: Request processed in 585us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938117.279687:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1784938117.279708:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279716:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938117.279723:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d0215bc00/0x26783cd1c59ee06e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938117.279927:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144117376:0@lo:103: 00080000:10000000:2.0:1784938117.280851:0:8422:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1784938117.281026:0:8422:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:3.0:1784938117.281119:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938117.281136:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144117504:192.168.203.126@tcp:41: 00080000:10000000:2.0:1784938117.281250:0:8422:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1784938117.281407:0:8422:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1784938117.281618:0:8422:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1784938117.281820:0:8422:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1784938117.281923:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938117.281999:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144117504 00000100:00100000:1.0:1784938117.282008:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144117504 00000100:00100000:1.0:1784938117.282054:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 29 00000100:00100000:1.0:1784938117.282063:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144117504:12345-192.168.203.126@tcp:41: 00000004:00000024:1.0:1784938117.282095:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784938117.282141:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144117504:12345-192.168.203.126@tcp:41: Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938117.282148:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 29 00000100:00100000:3.0:1784938117.282411:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144117504:192.168.203.126@tcp:41: 00000001:00000004:2.0:1784938117.288777:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1784938117.300113:0:8422:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1784938117.300123:0:8422:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1784938117.300170:0:8422:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784938117.300209:0:8422:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784938117.300304:0:8422:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784938117.300326:0:8422:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1784938117.301792:0:8422:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938117.301992:0:8422:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1784938117.729044:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784938118.499351:0:8506:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938118.499587:0:8506:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784938118.761312:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938119.780178:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938120.808514:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938120.864653:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144117632:192.168.203.126@tcp:41: 00000100:00100000:1.0:1784938120.865071:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938120.865143:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144117632 00000100:00100000:2.0:1784938120.865158:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144117632 00000100:00100000:2.0:1784938120.865270:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00100000:2.0:1784938120.865282:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144117632:12345-192.168.203.126@tcp:41: 00000004:00000024:2.0:1784938120.865322:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1784938120.865405:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144117632:12345-192.168.203.126@tcp:41: Request processed in 126us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938120.865413:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00100000:3.0:1784938120.865673:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144117632:192.168.203.126@tcp:41: 00010000:00010000:2.0:1784938121.825629:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938122.399520:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938122.399560:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144117760:192.168.203.126@tcp:41: 00000100:00100000:0.0:1784938122.399918:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938122.399955:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144117760 00000100:00100000:0.0:1784938122.399963:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144117760 00000100:00100000:0.0:1784938122.400014:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:0.0:1784938122.400023:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144117760:12345-192.168.203.126@tcp:41: 00000004:00000024:0.0:1784938122.400068:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1784938122.400431:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144117760:12345-192.168.203.126@tcp:41: Request processed in 407us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.400439:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:0.0:1784938122.400872:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144117760:192.168.203.126@tcp:41: 00000100:00100000:3.0:1784938122.401944:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144117888:0@lo:400: 00000100:00100000:3.0:1784938122.402016:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938122.402498:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144118272:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938122.402715:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938122.402764:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144118016:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938122.402816:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938122.402823:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144118144:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938122.402945:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938122.402968:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938122.402998:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144118144 00000100:00100000:0.0:1784938122.403005:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144118144 00000100:00100000:0.0:1784938122.403057:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:0.0:1784938122.403067:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144118144:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938122.403461:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144118144:12345-192.168.203.126@tcp:400: Request processed in 393us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.403490:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:0.0:1784938122.403614:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144118144:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938122.403659:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144118272 00000100:00100000:0.0:1784938122.403664:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144118272 00000100:00100000:0.0:1784938122.403691:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144118016 00000100:00100000:0.0:1784938122.403695:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144118016 00000100:00100000:0.0:1784938122.403710:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:0.0:1784938122.403717:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144118272:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938122.403750:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144118272:12345-192.168.203.126@tcp:400: Request processed in 33us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.403757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:0.0:1784938122.403770:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:0.0:1784938122.403776:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144118016:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938122.403812:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144118016:12345-192.168.203.126@tcp:400: Request processed in 36us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.403819:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00010000:00080000:0.0:1784938122.405909:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4bad80 x1871643144118272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938122.405934:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144118272:192.168.203.126@tcp:400: 00010000:00080000:0.0:1784938122.405983:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4bb100 x1871643144118016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938122.405993:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144118016:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938122.406462:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144117888 00000100:00100000:2.0:1784938122.406472:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144117888 00000100:00100000:2.0:1784938122.406550:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784938122.406561:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:3643:x1871643144117888:12345-0@lo:400: 00000100:00100000:1.0:1784938122.410956:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938122.410990:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144118400:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938122.411920:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938122.411956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144118400 00000100:00100000:1.0:1784938122.411982:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144118400 00000100:00100000:1.0:1784938122.412056:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:1.0:1784938122.412066:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144118400:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938122.412356:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144118400:12345-192.168.203.126@tcp:400: Request processed in 290us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938122.412365:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 16 00010000:00080000:1.0:1784938122.412590:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4b9880 x1871643144118400/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938122.412607:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144118400:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938122.412672:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144118528:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938122.412797:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938122.412817:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144118528 00000100:00100000:1.0:1784938122.412821:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144118528 00000100:00100000:1.0:1784938122.412846:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:1.0:1784938122.412853:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144118528:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938122.412896:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144118528:12345-192.168.203.126@tcp:400: Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938122.412903:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 17 00010000:00080000:1.0:1784938122.412986:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4b9880 x1871643144118528/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938122.412996:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144118528:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938122.415046:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:3643:x1871643144117888:12345-0@lo:400: Request processed in 8474us (13017us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938122.415064:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1784938122.415329:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938122.415336:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938122.417605:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144117888:0@lo:400: 00010000:00010000:0.0:1784938122.859550:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938123.887891:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784938124.449717:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784938124.449724:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cc481d800 from 30 10000000:01000000:0.0:1784938124.449730:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784938124.449786:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.449797:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.449807:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938124.449830:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144118656:0@lo:101: 00000100:00100000:0.0:1784938124.449900:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.449963:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.450063:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144118656 00000100:00100000:1.0:1784938124.450071:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144118656 00000100:00100000:1.0:1784938124.450122:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784938124.450137:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+14:6510:x1871643144118656:12345-0@lo:101: 00010000:00010000:1.0:1784938124.450151:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938124.450163:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee075 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.450186:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee075 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.450199:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee075 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.450207:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1e00, rc 0) 00000100:00100000:1.0:1784938124.450269:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144118656:12345-0@lo:101: Request processed in 134us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.450276:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784938124.450402:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144118656:0@lo:101: 00010000:00010000:0.0:1784938124.450417:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.450427:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938124.450499:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144118784:0@lo:501: 00000100:00100000:0.0:1784938124.450527:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.450563:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938124.450793:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144118784 00000100:00100000:3.0:1784938124.450798:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144118784 00000100:00100000:3.0:1784938124.450830:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784938124.450837:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144118784:12345-0@lo:501: 00000100:00100000:3.0:1784938124.450964:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144118784:12345-0@lo:501: Request processed in 128us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.450971:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784938124.452820:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144118784:0@lo:501: 00000100:00100000:0.0:1784938124.452880:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144118912:0@lo:503: 00000100:00100000:0.0:1784938124.452947:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.452997:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.453913:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144118912 00000100:00100000:1.0:1784938124.453921:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144118912 00000100:00100000:1.0:1784938124.453976:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784938124.453985:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144118912:12345-0@lo:503: 00000100:00100000:1.0:1784938124.454129:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144118912:12345-0@lo:503: Request processed in 145us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.454138:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784938124.454783:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144118912:0@lo:503: 00000100:00100000:0.0:1784938124.457045:0:8755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8755:1871643144119040:0@lo:502: 00000100:00100000:0.0:1784938124.457126:0:8755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.457169:0:8755:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.458840:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144119040 00000100:00100000:1.0:1784938124.458852:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144119040 00000100:00100000:1.0:1784938124.458920:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784938124.458931:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8755:x1871643144119040:12345-0@lo:502: 00000100:00100000:1.0:1784938124.459109:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8755:x1871643144119040:12345-0@lo:502: Request processed in 179us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.459126:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784938124.459397:0:8755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8755:1871643144119040:0@lo:502: 00000100:00100000:0.0:1784938124.459473:0:8755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8755:1871643144119168:0@lo:502: 00000100:00100000:0.0:1784938124.459516:0:8755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.459562:0:8755:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938124.459752:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144119168 00000100:00100000:3.0:1784938124.459757:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144119168 00000100:00100000:3.0:1784938124.459800:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784938124.459808:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8755:x1871643144119168:12345-0@lo:502: 00000100:00100000:3.0:1784938124.459897:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:8755:x1871643144119168:12345-0@lo:502: Request processed in 91us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.459904:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784938124.460837:0:8755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8755:1871643144119168:0@lo:502: 00000040:00080000:0.0:1784938124.460868:0:8755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1784938124.462176:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1784938124.462209:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938124.462249:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.462259:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938124.462269:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784938124.462271:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cc481d800 from 5 10000000:01000000:1.0:1784938124.462274:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938124.462311:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.462318:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.462328:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938124.462347:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119296:0@lo:101: 00000100:00100000:1.0:1784938124.462403:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938124.462437:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd2947900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.462469:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144119296 00000100:00100000:1.0:1784938124.462475:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144119296 00000100:00100000:1.0:1784938124.462516:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784938124.462524:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144119296:12345-0@lo:101: 00010000:00010000:1.0:1784938124.462547:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938124.462572:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee083 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.462596:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee083 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.462680:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee083 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.462690:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0c00, rc 0) 00000100:00100000:1.0:1784938124.462725:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144119296:12345-0@lo:101: Request processed in 202us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.462732:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784938124.464197:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119296:0@lo:101: 00010000:00010000:0.0:1784938124.464240:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.464251:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938124.464322:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119424:0@lo:256: 00000100:00100000:0.0:1784938124.464373:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.464403:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.466959:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144119424 00000100:00100000:1.0:1784938124.466978:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144119424 00000100:00100000:1.0:1784938124.467045:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784938124.467056:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144119424:12345-0@lo:256: 20000000:01000000:1.0:1784938124.467081:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938124.467105:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938124.467108:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1784938124.467288:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144119424:12345-0@lo:256: Request processed in 233us (2912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.467295:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784938124.467369:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119424:0@lo:256: 10000000:01000000:1.0:1784938124.467420:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938124.467428:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.467437:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938124.467832:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784938124.467835:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1784938124.467838:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784938124.467866:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.467874:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.467882:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938124.467901:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119552:0@lo:101: 00000100:00100000:1.0:1784938124.467935:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938124.467973:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd29479c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.468027:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144119552 00000100:00100000:0.0:1784938124.468033:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144119552 00000100:00100000:0.0:1784938124.468070:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784938124.468079:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144119552:12345-0@lo:101: 00010000:00010000:0.0:1784938124.468088:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938124.468108:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee091 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.468129:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee091 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.468139:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee091 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.468148:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76400, rc 0) 00000100:00100000:0.0:1784938124.468189:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144119552:12345-0@lo:101: Request processed in 111us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.468194:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784938124.468467:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119552:0@lo:101: 00010000:00010000:2.0:1784938124.468482:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938124.468491:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938124.468555:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119680:0@lo:501: 00000100:00100000:2.0:1784938124.468583:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938124.468620:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc37f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.468801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144119680 00000100:00100000:0.0:1784938124.468806:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144119680 00000100:00100000:0.0:1784938124.468840:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784938124.468848:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144119680:12345-0@lo:501: 00000100:00100000:0.0:1784938124.468970:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144119680:12345-0@lo:501: Request processed in 121us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.468977:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784938124.469010:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119680:0@lo:501: 00000100:00100000:0.0:1784938124.469040:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119808:0@lo:503: 00000100:00100000:0.0:1784938124.469085:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.469098:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.469109:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144119808 00000100:00100000:0.0:1784938124.469113:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144119808 00000100:00100000:0.0:1784938124.469129:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784938124.469134:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144119808:12345-0@lo:503: 00000100:00100000:0.0:1784938124.469240:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144119808:12345-0@lo:503: Request processed in 104us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.469247:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784938124.469284:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144119808:0@lo:503: 00000100:00100000:0.0:1784938124.469469:0:8756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8756:1871643144119936:0@lo:502: 00000100:00100000:0.0:1784938124.469502:0:8756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.469519:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144119936 00000100:00100000:0.0:1784938124.469523:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144119936 00000100:00100000:0.0:1784938124.469551:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784938124.469557:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:8756:x1871643144119936:12345-0@lo:502: 00000100:00100000:0.0:1784938124.469944:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:8756:x1871643144119936:12345-0@lo:502: Request processed in 386us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.469951:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784938124.469981:0:8756:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.469994:0:8756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8756:1871643144119936:0@lo:502: 00000020:01000000:0.0:1784938124.470016:0:8756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784938124.470023:0:8756:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784938124.470029:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938124.470031:0:8756:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784938124.470036:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938124.470040:0:8756:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1784938124.470061:0:8756:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784938124.470063:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938124.470077:0:8756:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff910cfd764d40) 00000020:00000080:0.0:1784938124.470098:0:8756:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1784938124.470105:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938124.470193:0:8756:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1784938124.470204:0:8756:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784938124.470210:0:8756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59ee0a6 00010000:00080000:0.0:1784938124.470271:0:8756:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc6755000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1784938124.470533:0:8756:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1784938124.520783:0:8756:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784938124.520808:0:8756:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1784938124.521005:0:8756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938124.521258:0:8756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938124.521354:0:8756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1784938124.521441:0:8756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1784938124.523518:0:8760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938124.523525:0:8760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784938124.524275:0:8756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784938124.524289:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784938124.524332:0:8756:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784938124.524357:0:8756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ee0ad 00000100:00080000:0.0:1784938124.524370:0:8756:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:0.0:1784938124.524382:0:8756:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff910bc6755000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938124.524417:0:8756:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc587c000 x1871643144120064/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938124.524441:0:8756:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784938124.524768:0:8756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938124.524782:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938124.524784:0:8756:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784938124.524788:0:8756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938124.524793:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938124.524794:0:8756:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938124.524797:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938124.524799:0:8756:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784938124.524829:0:8756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8756:1871643144120192:0@lo:502: 00000100:00100000:0.0:1784938124.524907:0:8756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.524954:0:8756:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.524981:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144120192 00000100:00100000:0.0:1784938124.524987:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144120192 00000100:00100000:0.0:1784938124.525028:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784938124.525035:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:8756:x1871643144120192:12345-0@lo:502: 00000100:00100000:0.0:1784938124.525148:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:8756:x1871643144120192:12345-0@lo:502: Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.525156:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784938124.525211:0:8756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8756:1871643144120192:0@lo:502: 00000020:01000000:0.0:1784938124.525255:0:8756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938124.525259:0:8756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938124.525261:0:8756:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784938124.525265:0:8756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1784938124.525366:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1784938124.525387:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784938124.525397:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.525408:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938124.525417:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784938124.525420:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cca3c9000 from 30 10000000:01000000:0.0:1784938124.525422:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784938124.525461:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.525470:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.525479:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938124.525497:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144120320:0@lo:101: 00000100:00100000:0.0:1784938124.525524:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.525539:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.525551:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144120320 00000100:00100000:0.0:1784938124.525555:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144120320 00000100:00100000:0.0:1784938124.525578:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784938124.525584:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144120320:12345-0@lo:101: 00010000:00010000:0.0:1784938124.525592:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938124.525603:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.525636:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee0b4 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.525647:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee0b4 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.525656:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77600, rc 0) 00000100:00100000:0.0:1784938124.525684:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144120320:12345-0@lo:101: Request processed in 99us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.525690:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784938124.525720:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144120320:0@lo:101: 00010000:00010000:0.0:1784938124.525731:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.525740:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938124.525805:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144120448:0@lo:501: 00000100:00100000:0.0:1784938124.525831:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.525843:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.525854:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144120448 00000100:00100000:0.0:1784938124.525858:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144120448 00000100:00100000:0.0:1784938124.525878:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784938124.525884:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144120448:12345-0@lo:501: 00000100:00100000:0.0:1784938124.525979:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144120448:12345-0@lo:501: Request processed in 94us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.525986:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784938124.526015:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144120448:0@lo:501: 00000100:00100000:0.0:1784938124.526038:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144120576:0@lo:503: 00000100:00100000:0.0:1784938124.526073:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.526086:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9b64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.526096:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144120576 00000100:00100000:0.0:1784938124.526099:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144120576 00000100:00100000:0.0:1784938124.526121:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784938124.526126:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144120576:12345-0@lo:503: 00000100:00100000:0.0:1784938124.526193:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144120576:12345-0@lo:503: Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.526200:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784938124.526255:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144120576:0@lo:503: 00000100:00100000:2.0:1784938124.527577:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144120064:192.168.203.126@tcp:8: 00000100:00100000:2.0:1784938124.537808:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938124.537961:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144120064 00000100:00100000:0.0:1784938124.537970:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144120064 00000100:00100000:0.0:1784938124.538019:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:0.0:1784938124.538026:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1871643144120064:12345-192.168.203.126@tcp:8: 00010000:00080000:0.0:1784938124.538061:0:8429:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1784938124.538090:0:8429:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ee0c2 00002000:00100000:0.0:1784938124.538128:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff910bc6754800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1784938124.538133:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1784938124.538136:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784938124.538200:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784938124.538426:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:2.0:1784938124.539889:0:8762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8762:1871643144120704:0@lo:502: 00000100:00100000:2.0:1784938124.539971:0:8762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938124.540015:0:8762:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc2afce40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938124.542579:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938124.542616:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144120960:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938124.542877:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938124.542926:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144121088:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938124.543008:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938124.543017:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144121472:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938124.543109:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938124.543166:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938124.543194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144121088 00000100:00100000:3.0:1784938124.543200:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144121088 00000100:00100000:3.0:1784938124.543272:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144121472 00000100:00100000:3.0:1784938124.543276:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144121472 00000100:00100000:3.0:1784938124.543303:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:3.0:1784938124.543311:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144121088:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938124.543358:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144121088:12345-192.168.203.126@tcp:400: Request processed in 48us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.543374:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:3.0:1784938124.543391:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:3.0:1784938124.543397:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144121472:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938124.543423:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144121472:12345-192.168.203.126@tcp:400: Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.543429:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00080000:3.0:1784938124.543450:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784938124.543552:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc678fb80 x1871643144121472/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938124.543565:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144121472:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938124.543575:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfb2d4e00 x1871643144121088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938124.543584:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144121088:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938124.543831:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144120832:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938124.543879:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144121344:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938124.543911:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938124.543917:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144121216:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938124.544794:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938124.544817:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938124.544835:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938124.544927:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144120960 00000100:00100000:0.0:1784938124.544933:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144120960 00000100:00100000:0.0:1784938124.544966:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144121216 00000100:00100000:0.0:1784938124.544970:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144121216 00000100:00100000:0.0:1784938124.544985:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:0.0:1784938124.544993:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144120960:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938124.567018:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144120960:12345-192.168.203.126@tcp:400: Request processed in 22012us (24129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.567034:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:0.0:1784938124.567075:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00100000:0.0:1784938124.567090:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144121216:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938124.596531:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144120832 00000100:00100000:3.0:1784938124.596555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144120832 00000100:00100000:3.0:1784938124.596612:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144121344 00000100:00100000:3.0:1784938124.596617:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144121344 00000100:00100000:3.0:1784938124.596659:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:3.0:1784938124.596669:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144120832:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938124.596753:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144120832:12345-192.168.203.126@tcp:400: Request processed in 86us (51961us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.596788:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:3.0:1784938124.596809:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:3.0:1784938124.596815:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144121344:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938124.596842:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144121344:12345-192.168.203.126@tcp:400: Request processed in 28us (52025us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.596848:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:3.0:1784938124.596983:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144120960:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938124.597211:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfb2d5f80 x1871643144120832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938124.597241:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144120832:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938124.597256:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc678ca80 x1871643144121344/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938124.597263:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144121344:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938124.597609:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144121216:12345-192.168.203.126@tcp:400: Request processed in 30523us (52769us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.597619:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00100000:0.0:1784938124.597647:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144120704 00000100:00100000:0.0:1784938124.597651:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144120704 00000100:00100000:0.0:1784938124.597680:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784938124.597712:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:8762:x1871643144120704:12345-0@lo:502: 00000100:00100000:0.0:1784938124.597857:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:8762:x1871643144120704:12345-0@lo:502: Request processed in 147us (57887us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.597865:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784938124.598086:0:8762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8762:1871643144120704:0@lo:502: 00000100:00100000:0.0:1784938124.598148:0:8762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8762:1871643144121600:0@lo:502: 00000100:00100000:0.0:1784938124.598191:0:8762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.598252:0:8762:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179be40 going to sleep for 11 seconds 00000100:00080000:0.0:1784938124.598273:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910bc6752000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938124.598318:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1871643144120064:12345-192.168.203.126@tcp:8: Request processed in 60290us (60519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.598327:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00010000:00080000:0.0:1784938124.598421:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc587c000 x1871643144120064/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938124.598432:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938124.598438:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784938124.598520:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938124.598527:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784938124.598530:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc6755000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938124.598544:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938124.598549:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144120064:192.168.203.126@tcp:8: 00000004:00080000:0.0:1784938124.598571:0:8760:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938124.598639:0:8760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 192630423893ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784938124.598645:0:8760:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1784938124.598923:0:8761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8761:1871643144121728:192.168.203.126@tcp:700: 00000100:00100000:0.0:1784938124.599030:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938124.599062:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144121728 00000100:00100000:0.0:1784938124.599068:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144121728 00000100:00100000:0.0:1784938124.599103:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:0.0:1784938124.599111:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8761:x1871643144121728:12345-192.168.203.126@tcp:700: 00000100:00100000:0.0:1784938124.599143:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8437:1871643144121856:192.168.203.126@tcp:700: 00000100:00100000:0.0:1784938124.599176:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf7844780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.599262:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938124.599300:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144121856 00000100:00100000:0.0:1784938124.599304:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144121856 00000100:00100000:0.0:1784938124.599328:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:0.0:1784938124.599335:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8437:x1871643144121856:12345-192.168.203.126@tcp:700: 00000100:00100000:1.0:1784938124.599554:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144121600 00000100:00100000:1.0:1784938124.599559:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144121600 00000100:00100000:1.0:1784938124.599588:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784938124.599595:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:8762:x1871643144121600:12345-0@lo:502: 00000100:00100000:1.0:1784938124.599690:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:8762:x1871643144121600:12345-0@lo:502: Request processed in 94us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.599697:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784938124.603924:0:8762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8762:1871643144121600:0@lo:502: 00000040:00080000:0.0:1784938124.603972:0:8762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784938124.604102:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784938124.604123:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938124.604136:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.604146:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938124.604157:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938124.604160:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cca3c9000 from 5 10000000:01000000:0.0:1784938124.604163:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938124.604197:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.604245:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.604256:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938124.604280:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144121984:0@lo:101: 00000100:00100000:0.0:1784938124.604344:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.604376:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc179be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.604396:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144121984 00000100:00100000:0.0:1784938124.604403:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144121984 00000100:00100000:3.0:1784938124.604610:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144121216:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938124.604939:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784938124.604953:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144121984:12345-0@lo:101: 00010000:00010000:1.0:1784938124.604967:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938124.604981:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee0c9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.605018:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee0c9 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.605027:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee0c9 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.605035:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1200, rc 0) 00000100:00100000:1.0:1784938124.605083:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144121984:12345-0@lo:101: Request processed in 134us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.605089:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784938124.605131:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144121984:0@lo:101: 00010000:00010000:1.0:1784938124.605144:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.605153:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938124.605201:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144122112:0@lo:256: 00000100:00100000:1.0:1784938124.605251:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938124.605265:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd2947900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.605278:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144122112 00000100:00100000:1.0:1784938124.605282:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144122112 00000100:00100000:1.0:1784938124.605304:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784938124.605310:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144122112:12345-0@lo:256: 20000000:01000000:1.0:1784938124.605324:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938124.605339:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938124.605342:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1784938124.605416:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144122112:12345-0@lo:256: Request processed in 105us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.605424:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1784938124.607288:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938124.607300:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938124.607882:0:8761:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfb9e000 going to sleep for 11 seconds 00000004:00080000:0.0:1784938124.611884:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1784938124.615798:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144122112:0@lo:256: 10000000:01000000:2.0:1784938124.615889:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784938124.615900:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938124.615912:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938124.615922:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784938124.615925:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1784938124.615928:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784938124.615965:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938124.615974:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938124.615983:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938124.616002:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144122240:0@lo:101: 00000100:00100000:2.0:1784938124.616061:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938124.616102:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc2afc600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938124.616563:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144122240 00000100:00100000:3.0:1784938124.616570:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144122240 00000100:00100000:3.0:1784938124.616617:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784938124.616625:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144122240:12345-0@lo:101: 00010000:00010000:3.0:1784938124.616638:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938124.616652:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee0d7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938124.616674:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee0d7 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938124.616692:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee0d7 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938124.616701:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b600, rc 0) 00000100:00100000:3.0:1784938124.616745:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144122240:12345-0@lo:101: Request processed in 121us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.616751:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784938124.616808:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144122240:0@lo:101: 00010000:00010000:3.0:1784938124.616820:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938124.616829:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938124.616883:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144122368:0@lo:501: 00000100:00100000:3.0:1784938124.616909:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938124.616929:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938124.616939:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144122368 00000100:00100000:3.0:1784938124.616942:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144122368 00000100:00100000:3.0:1784938124.616960:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784938124.616967:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144122368:12345-0@lo:501: 00000100:00100000:3.0:1784938124.617069:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144122368:12345-0@lo:501: Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.617075:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784938124.617103:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144122368:0@lo:501: 00000100:00100000:3.0:1784938124.617129:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144122496:0@lo:503: 00000100:00100000:3.0:1784938124.617173:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938124.617186:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938124.617196:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144122496 00000100:00100000:3.0:1784938124.617199:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144122496 00000100:00100000:3.0:1784938124.617241:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784938124.617247:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144122496:12345-0@lo:503: 00000100:00100000:3.0:1784938124.617326:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144122496:12345-0@lo:503: Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.617332:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784938124.617369:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144122496:0@lo:503: 00000100:00100000:1.0:1784938124.623678:0:8763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8763:1871643144122624:0@lo:502: 00000100:00100000:1.0:1784938124.623765:0:8763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938124.623820:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144122624 00000100:00100000:1.0:1784938124.623827:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144122624 00000100:00100000:1.0:1784938124.623870:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784938124.623878:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:8763:x1871643144122624:12345-0@lo:502: 00000100:00100000:1.0:1784938124.624000:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:8763:x1871643144122624:12345-0@lo:502: Request processed in 122us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.624008:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784938124.624058:0:8763:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf78d5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.624080:0:8763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8763:1871643144122624:0@lo:502: 00000020:01000000:1.0:1784938124.624107:0:8763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938124.624114:0:8763:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784938124.624121:0:8763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938124.624124:0:8763:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784938124.624129:0:8763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938124.624134:0:8763:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:1.0:1784938124.624154:0:8763:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784938124.624157:0:8763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938124.624172:0:8763:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff910cfd2019c0) 00000020:00000080:1.0:1784938124.624195:0:8763:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1784938124.624202:0:8763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938124.624298:0:8763:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784938124.624304:0:8763:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784938124.624311:0:8763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ee0ec 00010000:00080000:1.0:1784938124.624341:0:8763:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc5b28000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1784938124.624980:0:8763:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:0.0:1784938124.631275:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1784938124.647681:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8437:x1871643144121856:12345-192.168.203.126@tcp:700: Request processed in 48332us (48405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938124.647700:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00010000:00080000:1.0:1784938124.649885:0:8437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc587d180 x1871643144121856/t0(0) o700->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:32/10 lens 264/248 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938124.649906:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8437:1871643144121856:192.168.203.126@tcp:700: 40000000:02000000:1.0:1784938124.649920:0:8437:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1784938124.655315:0:8763:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784938124.655347:0:8763:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784938124.655690:0:8763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938124.656314:0:8763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938124.656466:0:8763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1784938124.657712:0:8763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1784938124.671375:0:8764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938124.671388:0:8764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:0.0:1784938124.672021:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1784938124.672709:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8761:x1871643144121728:12345-192.168.203.126@tcp:700: Request processed in 73591us (73671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938124.672745:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000020:00000080:2.0:1784938124.674600:0:8763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938124.674988:0:8763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784938124.675048:0:8763:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784938124.675074:0:8763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ee0f3 00000100:00080000:2.0:1784938124.675086:0:8763:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:2.0:1784938124.675101:0:8763:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff910bc5b28000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938124.675137:0:8763:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc676c380 x1871643144122752/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938124.675169:0:8763:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784938124.675283:0:8763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938124.675287:0:8763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938124.675290:0:8763:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784938124.675294:0:8763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938124.675301:0:8763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1784938124.675301:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144122752:192.168.203.126@tcp:8: 00000020:00000080:2.0:1784938124.675304:0:8763:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938124.675313:0:8763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938124.675318:0:8763:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784938124.675348:0:8763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8763:1871643144122880:0@lo:502: 00000100:00100000:2.0:1784938124.681150:0:8763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938124.681206:0:8763:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc2afc780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.682121:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144122880 00000100:00100000:1.0:1784938124.682140:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144122880 00000100:00100000:1.0:1784938124.682244:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784938124.682259:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:8763:x1871643144122880:12345-0@lo:502: 00000100:00100000:1.0:1784938124.682562:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:8763:x1871643144122880:12345-0@lo:502: Request processed in 305us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.682572:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784938124.682595:0:8763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:8763:1871643144122880:0@lo:502: 00000020:01000000:2.0:1784938124.682644:0:8763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938124.682653:0:8763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938124.682655:0:8763:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784938124.682661:0:8763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1784938124.682908:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1784938124.682948:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784938124.682960:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.682983:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938124.682996:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784938124.682999:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff910cf3bf8000 from 1 10000000:01000000:1.0:1784938124.683002:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784938124.683044:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.683067:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.683078:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938124.683102:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144123008:0@lo:101: 00000100:00100000:1.0:1784938124.683151:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938124.683187:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf78d50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938124.686924:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938124.687047:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144123008 00000100:00100000:2.0:1784938124.687056:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144123008 00010000:00080000:1.0:1784938124.687163:0:8761:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc587c000 x1871643144121728/t0(0) o700->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:31/4 lens 264/248 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938124.687186:0:8761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8761:1871643144121728:192.168.203.126@tcp:700: 00000100:00100000:1.0:1784938124.687364:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144122752 00000100:00100000:1.0:1784938124.687372:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144122752 00000100:00100000:1.0:1784938124.687424:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:1.0:1784938124.687432:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1871643144122752:12345-192.168.203.126@tcp:8: 00010000:00080000:1.0:1784938124.687469:0:8431:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1784938124.687521:0:8431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ee101 00002000:00100000:1.0:1784938124.687711:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff910cc4819800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784938124.687717:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784938124.687720:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784938124.688072:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784938124.688112:0:8431:0:(import.c:65:import_set_state_nolock()) ffff910cc487a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938124.688205:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1871643144122752:12345-192.168.203.126@tcp:8: Request processed in 771us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.688254:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00010000:00080000:1.0:1784938124.690188:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676c380 x1871643144122752/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938124.690207:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938124.690247:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784938124.690261:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784938124.690270:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784938124.690275:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc5b28000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784938124.690303:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784938124.690315:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144122752:192.168.203.126@tcp:8: 00000004:00080000:0.0:1784938124.690321:0:8764:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938124.690401:0:8764:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 192722185601ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784938124.690409:0:8764:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1784938124.692754:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1784938124.695901:0:8765:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784938124.695936:0:8765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8765:1871643144123264:192.168.203.126@tcp:7: 00000100:00100000:1.0:1784938124.696013:0:8765:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf78d5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.696029:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938124.696042:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144123136:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938124.696259:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784938124.696277:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144123008:12345-0@lo:101: 00010000:00010000:2.0:1784938124.696292:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938124.696310:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee0fa expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938124.696336:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee0fa expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938124.696356:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee0fa expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938124.696365:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1600, rc 0) 00000100:00100000:2.0:1784938124.696427:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144123008:12345-0@lo:101: Request processed in 157us (13276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.698112:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144123008:0@lo:101: 00010000:00010000:0.0:1784938124.698136:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938124.698160:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938124.698275:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144123392:0@lo:501: 00000100:00100000:0.0:1784938124.698329:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938124.698362:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8d57780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.698457:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144123392 00000100:00100000:1.0:1784938124.698462:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144123392 00000100:00100000:3.0:1784938124.703042:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938124.703069:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938124.704818:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144123264 00000100:00100000:0.0:1784938124.704831:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144123264 00000100:00100000:0.0:1784938124.704895:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:0.0:1784938124.704906:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8765:x1871643144123264:12345-192.168.203.126@tcp:7: 00000100:00100000:2.0:1784938124.708454:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784938124.709881:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144123136 00000100:00100000:1.0:1784938124.709894:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144123136 00000100:00100000:1.0:1784938124.710339:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:1.0:1784938124.710352:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1871643144123136:12345-192.168.203.126@tcp:13: 00002000:00000024:1.0:1784938124.710386:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923906560 avail 3692384256 00000100:00100000:1.0:1784938124.710465:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1871643144123136:12345-192.168.203.126@tcp:13: Request processed in 116us (7393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.710480:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00080000:0.0:1784938124.710983:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938124.713748:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00010000:00080000:1.0:1784938124.713748:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4b9c00 x1871643144123136/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938124.713763:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144123392:12345-0@lo:501: 00000100:00100000:1.0:1784938124.713781:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144123136:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938124.713893:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144123392:12345-0@lo:501: Request processed in 134us (15562us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938124.713902:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784938124.714873:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144123392:0@lo:501: 10000000:01000000:1.0:1784938124.714918:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784938124.714928:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938124.714939:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938124.718800:0:8761:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1784938124.718831:0:8761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8761:1871643144123648:192.168.203.126@tcp:7: 00000100:00100000:1.0:1784938124.718924:0:8761:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf78d5840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.718942:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144123520:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938124.719550:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938124.719582:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938124.719612:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938124.719619:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784938124.719642:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144123520 00000100:00100000:2.0:1784938124.719648:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144123520 00000100:00100000:2.0:1784938124.719688:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:2.0:1784938124.719698:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144123520:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938124.720033:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923906560 avail 3692384256 00000100:00100000:2.0:1784938124.720088:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144123520:12345-192.168.203.126@tcp:13: Request processed in 391us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938124.720095:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00010000:00080000:2.0:1784938124.721420:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4b9c00 x1871643144123520/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938124.721456:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144123520:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938124.724874:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144123648 00000100:00100000:2.0:1784938124.724887:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144123648 00000100:00100000:1.0:1784938124.725097:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:1.0:1784938124.725107:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8761:x1871643144123648:12345-192.168.203.126@tcp:7: 00002000:00080000:0.0:1784938124.731376:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1784938124.731385:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1784938124.731662:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8765:x1871643144123264:12345-192.168.203.126@tcp:7: Request processed in 26752us (28622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938124.731673:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00002000:00080000:1.0:1784938124.732785:0:8770:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1784938124.732791:0:8770:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1784938124.732845:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8761:x1871643144123648:12345-192.168.203.126@tcp:7: Request processed in 7736us (13295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.732854:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00010000:00080000:1.0:1784938124.733236:0:8765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4bbb80 x1871643144123264/t0(0) o7->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938124.733259:0:8765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8765:1871643144123264:192.168.203.126@tcp:7: 00000004:00080000:1.0:1784938124.733273:0:8765:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1784938124.733313:0:8765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8765:1871643144123776:192.168.203.126@tcp:5: 00000100:00100000:1.0:1784938124.733660:0:8765:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf78d5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.733760:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:2.0:1784938124.733843:0:8761:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4b8a80 x1871643144123648/t0(0) o7->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938124.733855:0:8761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8761:1871643144123648:192.168.203.126@tcp:7: 00000004:00080000:2.0:1784938124.733863:0:8761:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784938124.733885:0:8761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8761:1871643144123904:192.168.203.126@tcp:5: 00000100:00100000:2.0:1784938124.733916:0:8761:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc2afc840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938124.733932:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144123776 00000100:00100000:2.0:1784938124.733937:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144123776 00000100:00100000:2.0:1784938124.733988:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:2.0:1784938124.733996:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8765:x1871643144123776:12345-192.168.203.126@tcp:5: 00002000:00080000:2.0:1784938124.734020:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784938124.734024:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784938124.734737:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938124.734761:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144123904 00000100:00100000:1.0:1784938124.734766:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144123904 00000100:00100000:1.0:1784938124.734807:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:1.0:1784938124.734815:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8761:x1871643144123904:12345-192.168.203.126@tcp:5: 00002000:00080000:1.0:1784938124.734832:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1784938124.734870:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8761:x1871643144123904:12345-192.168.203.126@tcp:5: Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.734877:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00010000:00080000:2.0:1784938124.735174:0:8761:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676df80 x1871643144123904/t0(0) o5->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938124.735186:0:8761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8761:1871643144123904:192.168.203.126@tcp:5: 00000004:00080000:2.0:1784938124.735196:0:8761:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784938124.743705:0:8761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8761:1871643144124032:192.168.203.126@tcp:5: 00000100:00100000:2.0:1784938124.743798:0:8761:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc2afc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938124.744303:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938124.744332:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144124032 00000100:00100000:0.0:1784938124.744340:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144124032 00000100:00100000:0.0:1784938124.744388:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:0.0:1784938124.744396:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8761:x1871643144124032:12345-192.168.203.126@tcp:5: 00002000:00080000:0.0:1784938124.744459:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1784938124.750669:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8761:x1871643144124032:12345-192.168.203.126@tcp:5: Request processed in 6264us (6359us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784938124.750683:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00010000:00080000:2.0:1784938124.752466:0:8761:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676df80 x1871643144124032/t0(0) o5->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938124.752502:0:8761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8761:1871643144124032:192.168.203.126@tcp:5: 00000004:00080000:2.0:1784938124.752517:0:8761:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1784938124.752561:0:8761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8761:1871643144124160:192.168.203.126@tcp:900: 00000100:00100000:2.0:1784938124.752619:0:8761:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc2afc840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.756326:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938124.756364:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144124160 00000100:00100000:1.0:1784938124.756373:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144124160 00000100:00100000:1.0:1784938124.756426:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:1.0:1784938124.756436:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8761:x1871643144124160:12345-192.168.203.126@tcp:900: 00000100:00100000:1.0:1784938124.756507:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8761:x1871643144124160:12345-192.168.203.126@tcp:900: Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.756515:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00010000:00080000:2.0:1784938124.757069:0:8761:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676e680 x1871643144124160/t0(0) o900->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:29/10 lens 264/248 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938124.757086:0:8761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8761:1871643144124160:192.168.203.126@tcp:900: 00000001:00080000:1.0:1784938124.764970:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1784938124.764990:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784938124.773876:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8765:x1871643144123776:12345-192.168.203.126@tcp:5: Request processed in 39869us (40105us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784938124.773890:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00010000:00080000:1.0:1784938124.795632:0:8765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4bbb80 x1871643144123776/t0(0) o5->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938124.795667:0:8765:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784938124.795675:0:8765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8765:1871643144123776:192.168.203.126@tcp:5: 00000004:00080000:1.0:1784938124.795691:0:8765:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784938124.795751:0:8765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8765:1871643144124288:192.168.203.126@tcp:700: 00000100:00100000:1.0:1784938124.795829:0:8765:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf78d5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938124.795927:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938124.795961:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144124288 00000100:00100000:1.0:1784938124.795967:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144124288 00000100:00100000:1.0:1784938124.796008:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:1.0:1784938124.796016:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8765:x1871643144124288:12345-192.168.203.126@tcp:700: 00000001:00080000:2.0:1784938124.801970:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1784938124.802243:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8765:x1871643144124288:12345-192.168.203.126@tcp:700: Request processed in 6221us (6310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938124.802256:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00010000:00080000:1.0:1784938124.804038:0:8765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4bbb80 x1871643144124288/t0(0) o700->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:31/4 lens 264/248 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938124.804059:0:8765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8765:1871643144124288:192.168.203.126@tcp:700: 00000004:02000040:0.0:1784938124.817725:0:8765:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1784938124.831246:0:8765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8765:1871643144124416:192.168.203.126@tcp:5: 00000100:00100000:1.0:1784938124.831341:0:8765:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf78d5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938124.831574:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938124.831951:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144124416 00000100:00100000:0.0:1784938124.831960:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144124416 00000100:00100000:0.0:1784938124.832010:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:0.0:1784938124.832018:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8765:x1871643144124416:12345-192.168.203.126@tcp:5: 00002000:00080000:1.0:1784938124.849500:0:8770:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1784938124.853148:0:8770:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1784938124.854866:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8765:x1871643144124416:12345-192.168.203.126@tcp:5: Request processed in 22839us (23283us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784938124.854879:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00010000:00080000:1.0:1784938124.855127:0:8765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4bbb80 x1871643144124416/t0(0) o5->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938124.855146:0:8765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8765:1871643144124416:192.168.203.126@tcp:5: 00000004:00080000:1.0:1784938124.855161:0:8765:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1784938124.897890:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938125.244519:0:8805:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784938125.919623:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938125.984166:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144124544:192.168.203.126@tcp:41: 00000100:00100000:3.0:1784938125.984489:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938125.984519:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144124544 00000100:00100000:3.0:1784938125.984526:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144124544 00000100:00100000:3.0:1784938125.984570:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 35 00000100:00100000:3.0:1784938125.984578:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144124544:12345-192.168.203.126@tcp:41: 00000004:00000024:3.0:1784938125.984679:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1784938125.984735:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144124544:12345-192.168.203.126@tcp:41: Request processed in 156us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938125.984742:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 35 00000100:00100000:3.0:1784938125.984965:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144124544:192.168.203.126@tcp:41: 00000020:00000004:0.0:1784938126.349501:0:8857:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784938126.349717:0:8857:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784938126.946210:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938127.523412:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938127.523441:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144124672:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938127.523702:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938127.524157:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144124672 00000100:00100000:0.0:1784938127.524177:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144124672 00000100:00100000:0.0:1784938127.524403:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:0.0:1784938127.524414:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144124672:12345-192.168.203.126@tcp:41: 00000004:00000024:0.0:1784938127.524449:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1784938127.524505:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144124672:12345-192.168.203.126@tcp:41: Request processed in 92us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938127.524512:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:2.0:1784938127.524862:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144124672:192.168.203.126@tcp:41: 00000001:00080000:2.0:1784938127.554664:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1784938127.967398:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938129.005416:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784938129.892351:0:8959:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938129.892637:0:8959:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784938130.024884:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938130.079463:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938130.079499:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144124800:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938130.080037:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144125312:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.080084:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144125824:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.080120:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784938130.080127:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144125184:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.080171:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144125696:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.080449:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938130.080506:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938130.080530:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938130.080553:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938130.080570:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938130.080589:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144125056:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.080620:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144125568:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.080642:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784938130.080648:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144124928:0@lo:400: 00000100:00100000:2.0:1784938130.080677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938130.080783:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144125440:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.080814:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144125952:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.080937:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938130.080967:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938130.080980:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938130.081002:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938130.081029:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144125312 00000100:00100000:2.0:1784938130.081038:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144125312 00000100:00100000:2.0:1784938130.081077:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144125696 00000100:00100000:2.0:1784938130.081080:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144125696 00000100:00100000:2.0:1784938130.081108:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144125056 00000100:00100000:2.0:1784938130.081111:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144125056 00000100:00100000:2.0:1784938130.081122:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144125568 00000100:00100000:2.0:1784938130.081124:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144125568 00000100:00100000:2.0:1784938130.081149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:2.0:1784938130.081157:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144125312:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.081206:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144125312:12345-192.168.203.126@tcp:400: Request processed in 49us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938130.081233:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:2.0:1784938130.081252:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:2.0:1784938130.081259:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144125696:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.081284:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144125696:12345-192.168.203.126@tcp:400: Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938130.081290:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:2.0:1784938130.081302:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:2.0:1784938130.081308:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144125056:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.081330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144125056:12345-192.168.203.126@tcp:400: Request processed in 22us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938130.081335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:2.0:1784938130.081348:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:2.0:1784938130.081354:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144125568:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.081375:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144125568:12345-192.168.203.126@tcp:400: Request processed in 22us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938130.081381:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:2.0:1784938130.081399:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144125184 00000100:00100000:2.0:1784938130.081402:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144125184 00000100:00100000:2.0:1784938130.081423:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144125440 00000100:00100000:2.0:1784938130.081426:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144125440 00000100:00100000:2.0:1784938130.081437:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:2.0:1784938130.081453:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144125184:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.081479:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144125184:12345-192.168.203.126@tcp:400: Request processed in 29us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938130.081485:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:2.0:1784938130.081496:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:2.0:1784938130.081502:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144125440:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938130.081523:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144125440:12345-192.168.203.126@tcp:400: Request processed in 22us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938130.081529:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:2.0:1784938130.081547:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144124800 00000100:00100000:2.0:1784938130.081550:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144124800 00000100:00100000:2.0:1784938130.081575:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:2.0:1784938130.081581:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144124800:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938130.081605:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938130.081632:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144124800:12345-192.168.203.126@tcp:13: Request processed in 51us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938130.081638:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:2.0:1784938130.081657:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144125824 00000100:00100000:2.0:1784938130.081661:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144125824 00000100:00100000:2.0:1784938130.081683:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144125952 00000100:00100000:2.0:1784938130.081686:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144125952 00000100:00100000:1.0:1784938130.084150:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938130.084184:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144126080:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938130.084316:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:1.0:1784938130.084333:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144125824:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938130.084374:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144125824:12345-192.168.203.126@tcp:400: Request processed in 49us (3820us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938130.084382:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:2.0:1784938130.084813:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144124928 00000100:00100000:2.0:1784938130.084822:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144124928 00000100:00100000:2.0:1784938130.084908:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784938130.084918:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3641:x1871643144124928:12345-0@lo:400: 00000100:00100000:2.0:1784938130.084981:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3641:x1871643144124928:12345-0@lo:400: Request processed in 65us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938130.084997:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1784938130.086487:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938130.086495:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938130.086498:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784938130.087671:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676d180 x1871643144125824/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938130.087685:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784938130.087714:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144125824:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938130.087908:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:3.0:1784938130.088053:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd4b9f80 x1871643144124800/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938130.088062:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1784938130.088079:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144124800:192.168.203.126@tcp:13: 00000100:00100000:3.0:1784938130.088126:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144126080 00000100:00100000:3.0:1784938130.088132:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144126080 00000100:00100000:3.0:1784938130.088169:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938130.088177:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144126080:12345-192.168.203.126@tcp:13: 00002000:00000024:3.0:1784938130.088197:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938130.088278:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144126080:12345-192.168.203.126@tcp:13: Request processed in 101us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938130.088287:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938130.088417:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:3.0:1784938130.088424:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144125952:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938130.088459:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144125952:12345-192.168.203.126@tcp:400: Request processed in 35us (7456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938130.088478:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00010000:00080000:1.0:1784938130.092086:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc587ea00 x1871643144126080/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938130.092114:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144126080:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938130.092179:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144125184:192.168.203.126@tcp:400: 00010000:00080000:1.0:1784938130.092193:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676e300 x1871643144125696/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938130.092202:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144125696:192.168.203.126@tcp:400: 00010000:00080000:1.0:1784938130.092230:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676dc00 x1871643144125312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938130.092239:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144125312:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938130.092811:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144124928:0@lo:400: 00000100:00100000:3.0:1784938130.092830:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144125440:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938130.092843:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676f100 x1871643144125952/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938130.092852:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144125952:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938130.092865:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676fb80 x1871643144125056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938130.092873:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144125056:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938130.092885:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc676c700 x1871643144125568/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938130.092894:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144125568:192.168.203.126@tcp:400: 00010000:00010000:1.0:1784938131.039747:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938131.104789:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938131.104820:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144126208:192.168.203.126@tcp:41: 00000100:00100000:0.0:1784938131.105364:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938131.105503:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144126208 00000100:00100000:1.0:1784938131.105511:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144126208 00000100:00100000:1.0:1784938131.105556:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:1.0:1784938131.105565:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144126208:12345-192.168.203.126@tcp:41: 00000004:00000024:1.0:1784938131.105597:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1784938131.105645:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144126208:12345-192.168.203.126@tcp:41: Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938131.105653:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:1.0:1784938131.105786:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144126208:192.168.203.126@tcp:41: 00000020:00000004:0.0:1784938131.325424:0:9007:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784938131.325433:0:9007:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1784938132.066628:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938132.639411:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144126336:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938132.639889:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938132.640054:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144126336 00000100:00100000:0.0:1784938132.640062:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144126336 00000100:00100000:0.0:1784938132.640114:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:0.0:1784938132.640124:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144126336:12345-192.168.203.126@tcp:41: 00000004:00000024:0.0:1784938132.640158:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1784938132.640202:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144126336:12345-192.168.203.126@tcp:41: Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938132.640209:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:3.0:1784938132.640423:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144126336:192.168.203.126@tcp:41: 00010000:00010000:3.0:1784938133.087428:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938134.112692:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938135.137298:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938135.200651:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144126592:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.200768:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144127104:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.200851:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784938135.200859:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144126464:0@lo:400: 00000100:00100000:3.0:1784938135.200918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938135.200952:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144126976:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.200976:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144127488:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.201006:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144126720:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.201028:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144127232:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.201048:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938135.201053:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144126848:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.201071:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144127360:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.201605:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938135.201690:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938135.201736:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938135.201762:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938135.201783:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938135.201804:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938135.201824:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938135.201837:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938135.201866:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144126592 00000100:00100000:3.0:1784938135.201873:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144126592 00000100:00100000:3.0:1784938135.201910:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144127104 00000100:00100000:3.0:1784938135.201912:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144127104 00000100:00100000:3.0:1784938135.201933:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144127232 00000100:00100000:3.0:1784938135.201935:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144127232 00000100:00100000:3.0:1784938135.201946:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144126848 00000100:00100000:3.0:1784938135.201948:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144126848 00000100:00100000:3.0:1784938135.201962:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:3.0:1784938135.201970:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144126592:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.202029:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144126592:12345-192.168.203.126@tcp:400: Request processed in 59us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.202037:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:3.0:1784938135.202054:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:3.0:1784938135.202060:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144127104:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.202088:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144127104:12345-192.168.203.126@tcp:400: Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.202095:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:3.0:1784938135.202110:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00100000:3.0:1784938135.202117:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144127232:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.202139:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144127232:12345-192.168.203.126@tcp:400: Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.202144:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00100000:3.0:1784938135.202155:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 29 00000100:00100000:3.0:1784938135.202160:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144126848:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.202180:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144126848:12345-192.168.203.126@tcp:400: Request processed in 19us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.202185:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 29 00000100:00100000:3.0:1784938135.202207:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144126976 00000100:00100000:3.0:1784938135.204566:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144126976 00000100:00100000:3.0:1784938135.204628:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144126720 00000100:00100000:3.0:1784938135.204632:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144126720 00000100:00100000:3.0:1784938135.204652:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:3.0:1784938135.204659:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144126976:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.206091:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144126976:12345-192.168.203.126@tcp:400: Request processed in 1424us (4346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.206115:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:3.0:1784938135.206147:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:3.0:1784938135.206155:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144126720:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.206194:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144126720:12345-192.168.203.126@tcp:400: Request processed in 40us (4410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.206200:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:3.0:1784938135.206423:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144127488 00000100:00100000:3.0:1784938135.206430:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144127488 00000100:00100000:3.0:1784938135.206471:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144127360 00000100:00100000:3.0:1784938135.206474:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144127360 00000100:00100000:3.0:1784938135.206495:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:3.0:1784938135.206500:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144127488:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.206528:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144127488:12345-192.168.203.126@tcp:400: Request processed in 28us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.206534:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:3.0:1784938135.206546:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938135.206553:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144127360:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938135.206577:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144127360:12345-192.168.203.126@tcp:400: Request processed in 25us (4739us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.206582:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00080000:3.0:1784938135.206597:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938135.206602:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938135.206605:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938135.210612:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144126464 00000100:00100000:0.0:1784938135.210631:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144126464 00000100:00100000:0.0:1784938135.210680:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784938135.210688:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3641:x1871643144126464:12345-0@lo:400: 00000100:00100000:0.0:1784938135.211640:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3641:x1871643144126464:12345-0@lo:400: Request processed in 947us (10717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938135.211649:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784938135.211717:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938135.211737:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144127616:192.168.203.126@tcp:13: 00010000:00080000:1.0:1784938135.213055:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc678c380 x1871643144126848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938135.213072:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144126848:192.168.203.126@tcp:400: 00010000:00080000:1.0:1784938135.213086:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfb2d5f80 x1871643144127360/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938135.213108:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144127360:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938135.213120:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144126720:192.168.203.126@tcp:400: 00010000:00080000:1.0:1784938135.213131:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc678df80 x1871643144127232/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938135.213139:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144127232:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938135.213380:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144126464:0@lo:400: 00000100:00100000:2.0:1784938135.213394:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144126976:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938135.213405:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfb2d4000 x1871643144127488/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938135.213414:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144127488:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938135.213426:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc678d880 x1871643144126592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938135.213434:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144126592:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938135.213445:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc678ce00 x1871643144127104/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938135.213451:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144127104:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938135.214917:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144127744:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938135.215204:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938135.215484:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938135.216657:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144127616 00000100:00100000:1.0:1784938135.216672:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144127616 00000100:00100000:3.0:1784938135.216895:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144127744 00000100:00100000:3.0:1784938135.216900:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144127744 00000100:00100000:3.0:1784938135.216924:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:3.0:1784938135.216942:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144127616:12345-192.168.203.126@tcp:13: 00002000:00000024:3.0:1784938135.216970:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938135.217023:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144127616:12345-192.168.203.126@tcp:13: Request processed in 81us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.217030:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:3.0:1784938135.217044:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:3.0:1784938135.217050:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144127744:12345-192.168.203.126@tcp:13: 00002000:00000024:3.0:1784938135.217060:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938135.217075:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144127744:12345-192.168.203.126@tcp:13: Request processed in 25us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.217081:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00010000:00080000:3.0:1784938135.217954:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc587c000 x1871643144127744/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938135.217973:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144127744:192.168.203.126@tcp:13: 00010000:00080000:0.0:1784938135.218024:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd733b80 x1871643144127616/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938135.218040:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144127616:192.168.203.126@tcp:13: 00010000:00010000:1.0:1784938136.160392:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938136.225511:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144127872:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938136.226020:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938136.226050:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144127872 00000100:00100000:2.0:1784938136.226056:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144127872 00000100:00100000:2.0:1784938136.226101:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:2.0:1784938136.226122:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144127872:12345-192.168.203.126@tcp:41: 00000004:00000024:2.0:1784938136.226155:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1784938136.226234:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144127872:12345-192.168.203.126@tcp:41: Request processed in 114us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938136.226242:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:2.0:1784938136.229076:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144127872:192.168.203.126@tcp:41: 00010000:00010000:2.0:1784938137.188863:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938137.761073:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938137.761101:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144128000:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938137.761363:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938137.761390:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144128000 00000100:00100000:2.0:1784938137.761396:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144128000 00000100:00100000:2.0:1784938137.761435:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:2.0:1784938137.761443:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144128000:12345-192.168.203.126@tcp:41: 00000004:00000024:2.0:1784938137.761476:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1784938137.761570:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144128000:12345-192.168.203.126@tcp:41: Request processed in 127us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938137.761578:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:2.0:1784938137.761726:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144128000:192.168.203.126@tcp:41: 00010000:00010000:1.0:1784938138.218037:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938139.286235:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938140.255574:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938140.319512:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144128256:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938140.319642:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144128768:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938140.319700:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938140.319708:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144128384:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938140.319734:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144128896:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938140.319923:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.320014:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.320069:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.320099:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.320136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144128256 00000100:00100000:3.0:1784938140.320143:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144128256 00000100:00100000:3.0:1784938140.320175:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144128768 00000100:00100000:3.0:1784938140.320179:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144128768 00000100:00100000:3.0:1784938140.320201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144128896 00000100:00100000:3.0:1784938140.320204:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144128896 00000100:00100000:3.0:1784938140.320249:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00100000:3.0:1784938140.320257:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144128256:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938140.320305:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144128256:12345-192.168.203.126@tcp:400: Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938140.320312:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00100000:3.0:1784938140.320329:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:3.0:1784938140.320336:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144128768:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938140.320360:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144128768:12345-192.168.203.126@tcp:400: Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938140.320367:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:3.0:1784938140.320379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:3.0:1784938140.320386:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144128896:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938140.320408:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144128896:12345-192.168.203.126@tcp:400: Request processed in 23us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938140.320414:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:3.0:1784938140.320434:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144128384 00000100:00100000:3.0:1784938140.320438:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144128384 00000100:00100000:3.0:1784938140.320463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:3.0:1784938140.320469:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144128384:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938140.320493:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144128384:12345-192.168.203.126@tcp:400: Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938140.320505:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00080000:3.0:1784938140.320530:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938140.320535:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938140.320709:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144128384:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938140.320723:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb14e00 x1871643144128896/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938140.320736:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144128896:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938140.320746:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb16d80 x1871643144128256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938140.320754:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144128256:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938140.320764:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb15500 x1871643144128768/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938140.320773:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144128768:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938140.320916:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144128128:0@lo:400: 00000100:00100000:2.0:1784938140.320957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938140.320985:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144128640:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938140.321021:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144129152:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938140.321058:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784938140.321065:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144128512:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938140.321084:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144129024:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938140.321111:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144128128 00000100:00100000:2.0:1784938140.321115:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144128128 00000100:00100000:2.0:1784938140.321144:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784938140.321151:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3641:x1871643144128128:12345-0@lo:400: 00000100:00100000:2.0:1784938140.321188:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3641:x1871643144128128:12345-0@lo:400: Request processed in 37us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938140.321194:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784938140.321257:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144128128:0@lo:400: 00000100:00100000:3.0:1784938140.323049:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144129280:192.168.203.126@tcp:13: 00000100:00100000:3.0:1784938140.323120:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938140.323128:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144129408:192.168.203.126@tcp:13: 00000100:00100000:3.0:1784938140.323382:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.323410:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.323435:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.323468:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.323488:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.323510:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938140.323532:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144129152 00000100:00100000:3.0:1784938140.323550:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144129152 00000100:00100000:3.0:1784938140.323591:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144129024 00000100:00100000:3.0:1784938140.323594:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144129024 00000100:00100000:3.0:1784938140.323617:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:3.0:1784938140.323625:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144129152:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938140.323996:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:1.0:1784938140.324008:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144129024:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938140.324040:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144129024:12345-192.168.203.126@tcp:400: Request processed in 36us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938140.324046:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:2.0:1784938140.324377:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144128640 00000100:00100000:2.0:1784938140.324384:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144128640 00000100:00100000:2.0:1784938140.324432:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:2.0:1784938140.324439:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144128640:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938140.324486:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144128640:12345-192.168.203.126@tcp:400: Request processed in 47us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938140.324492:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:2.0:1784938140.324512:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144129280 00000100:00100000:2.0:1784938140.324515:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144129280 00000100:00100000:2.0:1784938140.324530:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144129408 00000100:00100000:2.0:1784938140.324533:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144129408 00000100:00100000:2.0:1784938140.324545:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:2.0:1784938140.324550:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144129280:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938140.324569:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938140.324609:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144129280:12345-192.168.203.126@tcp:13: Request processed in 58us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938140.324616:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:2.0:1784938140.324640:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:2.0:1784938140.324646:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144129408:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938140.324657:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938140.324690:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144129408:12345-192.168.203.126@tcp:13: Request processed in 44us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938140.324696:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00010000:00080000:2.0:1784938140.324854:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb15f80 x1871643144129024/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938140.324869:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144129024:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938140.324881:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144128640:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938140.324890:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb16680 x1871643144129152/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938140.324898:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144129152:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938140.326332:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144128512 00000100:00100000:0.0:1784938140.326344:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144128512 00000100:00100000:0.0:1784938140.326412:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:0.0:1784938140.326421:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144128512:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938140.326483:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144128512:12345-192.168.203.126@tcp:400: Request processed in 64us (3047us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938140.326490:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:3.0:1784938140.327600:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144129152:12345-192.168.203.126@tcp:400: Request processed in 45us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938140.327614:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00080000:3.0:1784938140.327658:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784938140.327713:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd730000 x1871643144129408/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938140.327735:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144129408:192.168.203.126@tcp:13: 00010000:00080000:3.0:1784938140.327750:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc587d180 x1871643144129280/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938140.327762:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144129280:192.168.203.126@tcp:13: 00010000:00080000:2.0:1784938140.327915:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb16a00 x1871643144128512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938140.327926:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144128512:192.168.203.126@tcp:400: 00010000:00010000:1.0:1784938141.283340:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938141.344003:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938141.344033:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144129536:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938141.344541:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938141.344757:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144129536 00000100:00100000:0.0:1784938141.344766:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144129536 00000100:00100000:0.0:1784938141.344834:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:0.0:1784938141.344844:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144129536:12345-192.168.203.126@tcp:41: 00000004:00000024:0.0:1784938141.344880:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1784938141.344940:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144129536:12345-192.168.203.126@tcp:41: Request processed in 96us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938141.344947:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:3.0:1784938141.345296:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144129536:192.168.203.126@tcp:41: 00010000:00010000:3.0:1784938142.305505:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938142.881553:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938142.881600:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144129664:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938142.882405:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938142.883047:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144129664 00000100:00100000:1.0:1784938142.883060:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144129664 00000100:00100000:1.0:1784938142.883130:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:1.0:1784938142.883146:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144129664:12345-192.168.203.126@tcp:41: 00000004:00000024:1.0:1784938142.883195:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1784938142.883298:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144129664:12345-192.168.203.126@tcp:41: Request processed in 158us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938142.883335:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:1.0:1784938142.883568:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144129664:192.168.203.126@tcp:41: 00010000:00010000:3.0:1784938143.327390:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784938143.603826:0:9507:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:0.0:1784938143.603831:0:9507:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1784938143.603832:0:9507:0:(obd_mount.c:925:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1784938143.604544:0:9507:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff910cece6d800 00000020:01000004:0.0:1784938143.604569:0:9507:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1784938143.604588:0:9507:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784938143.604606:0:9507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff910cfd7619c0) 00000020:00000080:0.0:1784938143.604628:0:9507:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784938143.674486:0:9507:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1784938143.674803:0:9507:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1784938143.702812:0:9507:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784938143.703090:0:9507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784938143.703109:0:9507:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784938143.703122:0:9507:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26783cd1c59ee116 00000020:01000004:2.0:1784938143.703129:0:9507:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1784938143.703155:0:9507:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784938143.703159:0:9507:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784938143.703165:0:9507:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784938143.703198:0:9507:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1784938143.703202:0:9507:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784938143.724166:0:9507:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784938143.724287:0:9507:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1784938143.724292:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784938143.724294:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938143.724296:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938143.724297:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938143.724304:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938143.724305:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938143.724307:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938143.724308:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938143.724309:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938143.724311:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938143.724312:0:9507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938143.724317:0:9507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1784938143.724320:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938143.724321:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938143.724322:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938143.724323:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938143.724324:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938143.724325:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938143.724326:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938143.724327:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938143.724328:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938143.724329:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938143.724330:0:9507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938143.724399:0:9507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784938143.724425:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144129792:0@lo:253: 00000100:00100000:3.0:1784938143.724527:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.724605:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd3933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938143.725668:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144129792 00000100:00100000:1.0:1784938143.725684:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144129792 00000100:00100000:1.0:1784938143.725768:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784938143.725788:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:9507:x1871643144129792:12345-0@lo:253: 20000000:01000000:1.0:1784938143.725838:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784938143.725844:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1784938143.725858:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1784938143.725862:0:6506:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1784938143.726313:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938143.726738:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1784938143.726756:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1784938143.726783:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1784938143.726791:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1784938143.726805:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1784938143.726822:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1784938143.727026:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1784938143.727043:0:6506:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:1.0:1784938143.727046:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:1.0:1784938143.727058:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1784938143.727063:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784938143.727075:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1784938143.727080:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:1.0:1784938143.727092:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1784938143.727099:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784938143.727110:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1784938143.727135:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1784938143.727206:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1784938143.727251:0:6506:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:1.0:1784938143.727252:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:1.0:1784938143.727269:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1784938143.727275:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784938143.727286:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1784938143.727291:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:1.0:1784938143.727304:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1784938143.727311:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784938143.727324:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1784938143.727339:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1784938143.730132:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1784938143.730176:0:6506:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:1.0:1784938143.730179:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:1.0:1784938143.730197:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1784938143.730206:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784938143.730271:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1784938143.730278:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:1.0:1784938143.730292:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1784938143.730300:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784938143.730312:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1784938143.730331:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1784938143.730349:0:6506:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784938143.730352:0:6506:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784938143.730357:0:6506:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784938143.731533:0:6506:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784938143.731540:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784938143.738590:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1784938143.738668:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1784938143.738689:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1784938143.740153:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1784938143.740191:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1784938143.740205:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1784938143.740255:0:6506:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784938143.740258:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784938143.742028:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1784938143.742091:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1784938143.742109:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1784938143.742549:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1784938143.742573:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1784938143.742588:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1784938143.742606:0:6506:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1784938143.742609:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784938143.744157:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1784938143.744752:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1784938143.744780:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1784938143.745044:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1784938143.745066:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1784938143.745079:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1784938143.745091:0:6506:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1784938143.745094:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784938143.745794:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1784938143.745901:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1784938143.745927:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1784938143.745943:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1784938143.745966:0:6506:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784938143.745968:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784938143.747641:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1784938143.747726:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1784938143.747740:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1784938143.753474:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1784938143.753518:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1784938143.753534:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:0.0:1784938143.753559:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784938143.753587:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753609:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee00c expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753618:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee036 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753625:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee075 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753632:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee091 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753638:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee0b4 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753677:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee0d7 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753684:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee0fa expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753692:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753746:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee0fa expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.753780:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee0fa expref: 21 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.753803:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144129920:0@lo:104: 00000100:00100000:0.0:1784938143.754288:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938143.754354:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee0d7 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.754364:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee0d7 expref: 21 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.754374:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130048:0@lo:104: 00000100:00100000:0.0:1784938143.754399:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938143.754447:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee0b4 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.754455:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee0b4 expref: 21 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.754473:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130176:0@lo:104: 00000100:00100000:0.0:1784938143.754500:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938143.754518:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee091 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.754525:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee091 expref: 21 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.754532:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130304:0@lo:104: 00000100:00100000:0.0:1784938143.754552:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938143.754568:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee075 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.754576:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee075 expref: 21 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.754586:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130432:0@lo:104: 00000100:00100000:0.0:1784938143.754619:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.754631:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144129920 00000100:00100000:2.0:1784938143.754657:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144129920 00010000:00010000:0.0:1784938143.754657:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee036 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.754672:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee036 expref: 21 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.754681:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130560:0@lo:104: 00000100:00100000:0.0:1784938143.754711:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938143.754736:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee00c expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938143.754744:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1784938143.754764:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee00c expref: 21 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938143.754769:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144130048 00000100:00100000:2.0:1784938143.754775:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144130048 00000100:00100000:2.0:1784938143.754797:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144130176 00000100:00100000:2.0:1784938143.754800:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144130176 00000100:00100000:2.0:1784938143.754808:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144130304 00000100:00100000:2.0:1784938143.754810:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144130304 00000100:00100000:2.0:1784938143.754893:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144130432 00000100:00100000:2.0:1784938143.754897:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144130432 00000100:00100000:2.0:1784938143.754908:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144130560 00000100:00100000:2.0:1784938143.754910:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144130560 00000100:00100000:2.0:1784938143.754925:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938143.754933:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+8:6506:x1871643144129920:12345-0@lo:104: 00010000:00010000:2.0:1784938143.754950:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755044:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938143.755049:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+8:6506:x1871643144129920:12345-0@lo:104: Request processed in 117us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.755057:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938143.755075:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784938143.755080:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+7:6506:x1871643144130048:12345-0@lo:104: 00010000:00010000:2.0:1784938143.755205:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755263:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784938143.755268:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+7:6506:x1871643144130048:12345-0@lo:104: Request processed in 188us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.755274:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784938143.755286:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938143.755291:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+6:6506:x1871643144130176:12345-0@lo:104: 00010000:00010000:2.0:1784938143.755298:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755392:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784938143.755397:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+6:6506:x1871643144130176:12345-0@lo:104: Request processed in 106us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.755403:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938143.755414:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784938143.755419:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+5:6506:x1871643144130304:12345-0@lo:104: 00010000:00010000:2.0:1784938143.755426:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755455:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784938143.755459:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+5:6506:x1871643144130304:12345-0@lo:104: Request processed in 41us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.755465:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784938143.755474:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784938143.755479:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6506:x1871643144130432:12345-0@lo:104: 00010000:00010000:2.0:1784938143.755485:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755505:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1784938143.755517:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6506:x1871643144130432:12345-0@lo:104: Request processed in 30us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.755522:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784938143.755531:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784938143.755536:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc1445450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6506:x1871643144130560:12345-0@lo:104: 00010000:00010000:2.0:1784938143.755542:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755562:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1784938143.755566:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc1445450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6506:x1871643144130560:12345-0@lo:104: Request processed in 31us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.755571:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1784938143.755608:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1784938143.755614:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755621:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1c00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938143.755631:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755640:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938143.755656:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938143.755663:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938143.755693:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755700:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938143.755716:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755723:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee0fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee108 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755736:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784938143.755739:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755745:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1e00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938143.755748:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755754:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938143.755770:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938143.755775:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938143.755786:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755791:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938143.755796:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755802:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee0d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee0de expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755811:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784938143.755814:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755825:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938143.755828:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755835:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938143.755842:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938143.755847:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938143.755863:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755869:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938143.755883:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755889:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee0b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee0bb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755898:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938143.755901:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755906:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938143.755909:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755916:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938143.755922:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938143.755927:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938143.755935:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.755939:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938143.755943:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756319:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee098 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756331:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938143.756334:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756341:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938143.756344:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756351:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938143.756358:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938143.756365:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938143.756392:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756399:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938143.756405:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756413:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b76600/0x26783cd1c59ee075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee07c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756423:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938143.756431:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756438:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77000 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938143.756441:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756449:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938143.756477:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938143.756485:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1784938143.756498:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130688:0@lo:104: 00010000:00010000:2.0:1784938143.756515:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756524:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938143.756530:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756537:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b77000/0x26783cd1c59ee036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee03d expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.756547:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938143.756549:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938143.756551:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938143.756565:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938143.756572:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938143.756582:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.756588:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144130816:0@lo:103: 00000100:00100000:0.0:1784938143.756642:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc634de40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938143.756658:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.756693:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144129920:0@lo:104: 00000100:00100000:2.0:1784938143.756710:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144131328:0@lo:103: 00000100:00100000:0.0:1784938143.756715:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130048:0@lo:104: 00000100:00100000:0.0:1784938143.756730:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130176:0@lo:104: 00000100:00100000:2.0:1784938143.758133:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.758201:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784938143.758211:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144130944:0@lo:103: 00000100:00100000:2.0:1784938143.758266:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.758631:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144131456:0@lo:103: 00000100:00100000:1.0:1784938143.758664:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144130816 00000100:00100000:1.0:1784938143.758673:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144130816 00000100:00100000:2.0:1784938143.758698:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784938143.758712:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee0fa expref: 22 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.758736:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144131328 00000100:00100000:1.0:1784938143.758739:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144131328 00000100:00100000:2.0:1784938143.758741:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144131072:0@lo:103: 00010000:00010000:1.0:1784938143.758753:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee075 expref: 23 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938143.758767:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938143.758779:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144130944 00000100:00100000:1.0:1784938143.758783:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144130944 00000100:00100000:2.0:1784938143.758785:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938143.758793:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144131200:0@lo:103: 00010000:00010000:1.0:1784938143.758798:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee0d7 expref: 24 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.758811:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144131456 00000100:00100000:1.0:1784938143.758814:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144131456 00000100:00100000:2.0:1784938143.758821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784938143.758828:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee036 expref: 25 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.758841:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144131072 00000100:00100000:1.0:1784938143.758852:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144131072 00000100:00100000:2.0:1784938143.758854:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144131200 00000100:00100000:2.0:1784938143.758860:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144131200 00010000:00010000:1.0:1784938143.758869:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee0b4 expref: 27 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.758881:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee091 expref: 27 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.758888:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784938143.758900:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+27:3642:x1871643144130816:12345-0@lo:103: 00000100:00100000:2.0:1784938143.758910:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1784938143.758914:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784938143.758920:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+27:3642:x1871643144131328:12345-0@lo:103: 00010000:00010000:1.0:1784938143.758922:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee0fa expref: 27 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.758934:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938143.758938:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee0fa expref: 27 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.758942:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee075 expref: 27 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.758960:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee0fa expref: 27 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.758969:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee075 expref: 27 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.758997:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938143.758998:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938143.759049:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+26:3642:x1871643144131328:12345-0@lo:103: Request processed in 130us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.759052:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+26:3642:x1871643144130816:12345-0@lo:103: Request processed in 152us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.759064:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938143.759071:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784938143.759088:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938143.759095:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784938143.759099:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144130944:12345-0@lo:103: 00000100:00100000:2.0:1784938143.759107:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144131456:12345-0@lo:103: 00010000:00010000:2.0:1784938143.759119:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938143.759124:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938143.759125:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee036 expref: 24 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.759133:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee0d7 expref: 24 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.759141:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee036 expref: 24 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938143.759708:0:7921:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1784938143.759729:0:7921:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1784938143.759828:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee0d7 expref: 24 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.759853:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938143.759853:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee0de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee0d7 expref: 24 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.759875:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938143.759895:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130304:0@lo:104: 00000100:00100000:2.0:1784938143.759904:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3642:x1871643144131456:12345-0@lo:103: Request processed in 793us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.759915:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3642:x1871643144130944:12345-0@lo:103: Request processed in 819us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.759917:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784938143.759927:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938143.759945:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784938143.759956:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3640:x1871643144131072:12345-0@lo:103: 00010000:00010000:2.0:1784938143.759968:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938143.759974:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee0b4 expref: 21 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.759982:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1784938143.759986:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee0b4 expref: 21 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.759999:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3640:x1871643144131200:12345-0@lo:103: 00010000:00010000:2.0:1784938143.760005:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77600/0x26783cd1c59ee0bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee0b4 expref: 21 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.760010:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938143.760020:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee091 expref: 20 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.760022:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938143.760035:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee091 expref: 20 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.760050:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee091 expref: 20 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.760063:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938143.760073:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+19:3640:x1871643144131072:12345-0@lo:103: Request processed in 118us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.760093:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1784938143.760102:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee07c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee075 expref: 19 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938143.761185:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144130944:0@lo:103: 00000100:00100000:2.0:1784938143.761208:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144131456:0@lo:103: 00000100:00100000:2.0:1784938143.761238:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144130816:0@lo:103: 00000100:00100000:2.0:1784938143.761248:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144131328:0@lo:103: 00000100:00100000:2.0:1784938143.761297:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144130688 00000100:00100000:0.0:1784938143.761299:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130432:0@lo:104: 00000100:00100000:2.0:1784938143.761305:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144130688 00000100:00100000:2.0:1784938143.761362:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784938143.761370:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6506:x1871643144130688:12345-0@lo:104: 00010000:00010000:2.0:1784938143.761385:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.761442:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938143.761448:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6506:x1871643144130688:12345-0@lo:104: Request processed in 79us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.761454:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1784938143.761477:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938143.761482:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.761490:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938143.761495:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.761504:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.761515:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d1000/0x26783cd1c59ee03d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee036 expref: 17 pid: 6507 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938143.761546:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938143.761556:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1784938143.761559:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130560:0@lo:104: 00000100:00100000:0.0:1784938143.761586:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1871643144130688:0@lo:104: 00010000:00010000:2.0:1784938143.761603:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.761613:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938143.761632:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.761641:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ee00c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee013 expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.761643:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.761690:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938143.761693:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938143.761696:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938143.761705:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938143.761719:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144131584:0@lo:103: 00000100:00100000:2.0:1784938143.761753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938143.761951:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:3640:x1871643144131200:12345-0@lo:103: Request processed in 111us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.761961:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784938143.761985:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144131584 00000100:00100000:1.0:1784938143.761990:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144131584 00000100:00100000:3.0:1784938143.762009:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144131200:0@lo:103: 00010000:00010000:1.0:1784938143.762013:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee00c expref: 16 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938143.762041:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144131072:0@lo:103: 00000100:00100000:1.0:1784938143.762048:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784938143.762060:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:3641:x1871643144131584:12345-0@lo:103: 00010000:00010000:1.0:1784938143.762072:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938143.762085:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee00c expref: 16 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762099:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee00c expref: 16 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762161:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d0400/0x26783cd1c59ee013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee00c expref: 16 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762179:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762188:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762204:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762235:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762243:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762251:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762258:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938143.762262:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762271:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.762299:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.762450:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.762461:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.762475:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee11d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784938143.762488:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1784938143.762937:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938143.762993:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:3641:x1871643144131584:12345-0@lo:103: Request processed in 936us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.763001:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784938143.763143:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144131584:0@lo:103: 00000100:00100000:0.0:1784938143.767094:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+14:9507:x1871643144129792:12345-0@lo:253: Request processed in 41299us (42557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.767309:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144129792:0@lo:253: 00000100:00100000:0.0:1784938143.767314:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 10000000:01000000:3.0:1784938143.767346:0:9507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784938143.767352:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938143.767355:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938143.767357:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938143.767359:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1784938143.767361:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938143.767363:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938143.767365:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938143.767367:0:9507:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784938143.767369:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938143.767371:0:9507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784938143.767415:0:9507:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910cece6d800 from lustre-OST0001 10000000:01000000:3.0:1784938143.767461:0:9507:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784938143.767465:0:9507:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784938143.767477:0:9507:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910cf3bf8000 local copy 10000000:01000000:3.0:1784938143.767483:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784938143.767534:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.767547:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.767559:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938143.767584:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144131712:0@lo:101: 00000100:00100000:3.0:1784938143.767664:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.767723:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144131712 00000100:00100000:3.0:1784938143.767728:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938143.767734:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144131712 00000100:00100000:2.0:1784938143.767789:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784938143.767799:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+14:9507:x1871643144131712:12345-0@lo:101: 00010000:00010000:2.0:1784938143.767813:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938143.767834:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d0c00/0x26783cd1c59ee12b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee124 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.767878:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d0c00/0x26783cd1c59ee12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee124 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.767890:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d0c00/0x26783cd1c59ee12b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee124 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.767900:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d0c00, rc 0) 00000100:00100000:2.0:1784938143.767951:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144131712:12345-0@lo:101: Request processed in 154us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.767958:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784938143.767998:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144131712:0@lo:101: 00010000:00010000:3.0:1784938143.768016:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.768041:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938143.768145:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144131840:0@lo:501: 00000100:00100000:3.0:1784938143.768177:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.768197:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.768286:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144131840 00000100:00100000:0.0:1784938143.768295:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144131840 00000100:00100000:1.0:1784938143.768395:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784938143.768405:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144131840:12345-0@lo:501: 00000100:00100000:1.0:1784938143.768498:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144131840:12345-0@lo:501: Request processed in 96us (320us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938143.768506:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784938143.768546:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144131840:0@lo:501: 10000000:01000000:3.0:1784938143.768562:0:9507:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784938143.768582:0:9507:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784938143.768587:0:9507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.768596:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.768604:0:9507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.768624:0:9507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784938143.768671:0:9507:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910cece6d800 10000000:01000000:3.0:1784938143.768676:0:9507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784938143.768682:0:9507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784938143.768684:0:9507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938143.768688:0:9507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784938143.768691:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784938143.768709:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.768728:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.768737:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938143.768749:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144131968:0@lo:101: 00000100:00100000:3.0:1784938143.768792:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.768819:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd09870c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784938143.769894:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938143.769906:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.769918:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938143.769923:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.769934:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938143.769941:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938143.769947:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938143.769982:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.769989:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784938143.770051:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144131968 00000100:00100000:0.0:1784938143.770058:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144131968 00000100:00100000:0.0:1784938143.770109:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784938143.770112:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144132096:0@lo:103: 00000100:00100000:0.0:1784938143.770121:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144131968:12345-0@lo:101: 00010000:00010000:0.0:1784938143.770132:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938143.770145:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee132 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.770163:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee132 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.770172:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee132 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.770183:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77800, rc 0) 00000100:00100000:3.0:1784938143.770192:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938143.770250:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.770265:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ee124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x26783cd1c59ee12b expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.770319:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144131968:12345-0@lo:101: Request processed in 202us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.770325:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784938143.770341:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144131968:0@lo:101: 00010000:00010000:3.0:1784938143.770369:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.770380:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144132096 00010000:00010000:3.0:1784938143.770383:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.770388:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144132096 00000100:00100000:3.0:1784938143.770520:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132224:0@lo:501: 00010000:00010000:2.0:1784938143.770546:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938143.770550:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938143.770554:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938143.770563:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.770596:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd09870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.770733:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144132224 00000100:00100000:1.0:1784938143.770754:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784938143.770756:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144132224 00000100:00100000:0.0:1784938143.770942:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784938143.770963:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144132224:12345-0@lo:501: 00000100:00100000:1.0:1784938143.770964:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:3641:x1871643144132096:12345-0@lo:103: 00010000:00010000:1.0:1784938143.770989:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938143.771014:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d0c00/0x26783cd1c59ee12b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee124 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.771037:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938143.771108:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:3641:x1871643144132096:12345-0@lo:103: Request processed in 344us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.771118:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784938143.771136:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144132224:12345-0@lo:501: Request processed in 184us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.771146:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784938143.771345:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132224:0@lo:501: 00000100:00100000:3.0:1784938143.771397:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132352:0@lo:503: 00000100:00100000:2.0:1784938143.771523:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144132096:0@lo:103: 00000100:00100000:3.0:1784938143.772029:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.772073:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd09870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.772153:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144132352 00000100:00100000:0.0:1784938143.772161:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144132352 00000100:00100000:0.0:1784938143.772208:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784938143.772250:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144132352:12345-0@lo:503: 00000100:00100000:2.0:1784938143.772717:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144132352:12345-0@lo:503: Request processed in 464us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.772730:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784938143.773019:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132352:0@lo:503: 00000040:00080000:3.0:1784938143.773462:0:9507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938143.773577:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132480:0@lo:502: 00000100:00100000:3.0:1784938143.773661:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.773699:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd09870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.774026:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144132480 00000100:00100000:0.0:1784938143.774034:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144132480 00000100:00100000:0.0:1784938143.774087:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784938143.774098:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144132480:12345-0@lo:502: 00000100:00100000:0.0:1784938143.774275:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144132480:12345-0@lo:502: Request processed in 179us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.774283:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784938143.774496:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132480:0@lo:502: 00000040:00080000:3.0:1784938143.776078:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784938143.776149:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784938143.776169:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784938143.776183:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784938143.776197:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784938143.776209:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784938143.776292:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132608:0@lo:502: 00000100:00100000:3.0:1784938143.776393:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.776458:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd09870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938143.779028:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144132608 00000100:00100000:2.0:1784938143.779052:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144132608 00000100:00100000:2.0:1784938143.779148:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784938143.779161:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144132608:12345-0@lo:502: 00000100:00100000:2.0:1784938143.779444:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144132608:12345-0@lo:502: Request processed in 285us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.779454:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784938143.780672:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132608:0@lo:502: 00000040:00080000:3.0:1784938143.780821:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784938143.780840:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1784938143.782297:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784938143.782312:0:9519:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1784938143.782321:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938143.782324:0:9519:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784938143.782330:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938143.782371:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff910bc71599c0) 00000020:00000080:3.0:1784938143.782408:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784938143.782417:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784938143.782519:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cece6d800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784938143.782530:0:9519:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784938143.782540:0:9519:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26783cd1c59ee147 00010000:00010000:2.0:1784938143.796666:0:9519:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1784938143.798391:0:9519:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1784938143.809057:0:9519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784938143.809626:0:9519:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1784938143.825513:0:9519:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1784938143.825766:0:9519:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1784938143.846829:0:9519:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1784938143.857100:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784938143.857121:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938143.864280:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938143.864291:0:9519:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1784938143.864308:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938143.864337:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938143.864339:0:9519:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784938143.864345:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784938143.864347:0:9519:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784938143.864387:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938143.864391:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938143.864392:0:9519:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784938143.864396:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1784938143.864906:0:9507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1784938143.864953:0:9507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784938143.864983:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.864998:0:9507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938143.865008:0:9507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cece6d800 from 1 10000000:01000000:0.0:1784938143.865011:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938143.865068:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.865086:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.865100:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.865129:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132736:0@lo:101: 00000100:00100000:0.0:1784938143.865243:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.865289:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938143.865436:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144132736 00000100:00100000:3.0:1784938143.865446:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144132736 00000100:00100000:3.0:1784938143.865509:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784938143.865520:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:9507:x1871643144132736:12345-0@lo:101: 00010000:00010000:3.0:1784938143.865537:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938143.865553:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee14e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.865582:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee14e expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.865594:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee14e expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.865605:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215ba00, rc 0) 00000100:00100000:3.0:1784938143.865670:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144132736:12345-0@lo:101: Request processed in 152us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.865677:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784938143.866470:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132736:0@lo:101: 00010000:00010000:0.0:1784938143.866493:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.866505:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.866666:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132864:0@lo:501: 00000100:00100000:0.0:1784938143.866721:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.866756:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938143.866993:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144132864 00000100:00100000:1.0:1784938143.867001:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144132864 00000100:00100000:1.0:1784938143.867042:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784938143.867051:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144132864:12345-0@lo:501: 00000100:00100000:1.0:1784938143.867193:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144132864:12345-0@lo:501: Request processed in 143us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.867201:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784938143.868978:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132864:0@lo:501: 00000100:00100000:0.0:1784938143.869066:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132992:0@lo:503: 00000100:00100000:0.0:1784938143.869149:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.869195:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938143.869364:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144132992 00000100:00100000:3.0:1784938143.869371:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144132992 00000100:00100000:3.0:1784938143.869435:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784938143.869446:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144132992:12345-0@lo:503: 00000100:00100000:3.0:1784938143.869590:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144132992:12345-0@lo:503: Request processed in 144us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.869607:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784938143.869675:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144132992:0@lo:503: 00000040:00080000:3.0:1784938143.869995:0:9507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938143.870087:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133120:0@lo:502: 00000100:00100000:3.0:1784938143.870130:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.870159:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938143.870178:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144133120 00000100:00100000:3.0:1784938143.870183:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144133120 00000100:00100000:3.0:1784938143.870209:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784938143.870257:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144133120:12345-0@lo:502: 00000100:00100000:3.0:1784938143.870354:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144133120:12345-0@lo:502: Request processed in 99us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.870362:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784938143.870411:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133120:0@lo:502: 00000040:00080000:3.0:1784938143.870661:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1784938143.870689:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1784938143.870709:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133248:0@lo:502: 00000100:00100000:3.0:1784938143.870747:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.870764:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1587600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938143.870779:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144133248 00000100:00100000:3.0:1784938143.870783:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144133248 00000100:00100000:3.0:1784938143.870806:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784938143.870813:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144133248:12345-0@lo:502: 00000100:00100000:3.0:1784938143.870878:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144133248:12345-0@lo:502: Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.870884:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784938143.870928:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133248:0@lo:502: 00000040:00080000:3.0:1784938143.870963:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1784938143.870970:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1784938143.878037:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938143.878057:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938143.878060:0:9523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784938143.878080:0:9523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cece6d800 00000020:00000080:0.0:1784938143.878083:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938143.878102:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938143.878105:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938143.878107:0:9523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784938143.878110:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784938143.878522:0:9507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784938143.878576:0:9507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938143.878604:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.878631:0:9507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938143.878719:0:9507:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784938143.878723:0:9507:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910cece6d800 10000000:01000000:2.0:1784938143.878726:0:9507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910cece6d800 10000000:01000000:2.0:1784938143.878731:0:9507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784938143.878738:0:9507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cece6d800 from 1 10000000:01000000:2.0:1784938143.878742:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938143.878947:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.878957:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.878970:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938143.879000:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133376:0@lo:101: 00000100:00100000:2.0:1784938143.879094:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.879151:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8d57900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.879531:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144133376 00000100:00100000:0.0:1784938143.879541:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144133376 00000100:00100000:0.0:1784938143.879604:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784938143.879615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9507:x1871643144133376:12345-0@lo:101: 00010000:00010000:0.0:1784938143.879633:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938143.879754:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee15c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.879853:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee15c expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.879867:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee15c expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.879877:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77e00, rc 0) 00000100:00100000:0.0:1784938143.879942:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144133376:12345-0@lo:101: Request processed in 329us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.879949:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784938143.880050:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133376:0@lo:101: 00010000:00010000:2.0:1784938143.880067:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.880076:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938143.880577:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133504:0@lo:501: 00000100:00100000:2.0:1784938143.880622:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.880705:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8d57900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.880982:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144133504 00000100:00100000:0.0:1784938143.880990:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144133504 00000100:00100000:0.0:1784938143.881063:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784938143.881073:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144133504:12345-0@lo:501: 00000100:00100000:0.0:1784938143.881389:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144133504:12345-0@lo:501: Request processed in 316us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.881514:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133504:0@lo:501: 00000100:00100000:2.0:1784938143.881555:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133632:0@lo:503: 00000100:00100000:2.0:1784938143.881607:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.881635:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784938143.881989:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8d57900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.882105:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144133632 00000100:00100000:0.0:1784938143.882111:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144133632 00000100:00100000:0.0:1784938143.882138:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784938143.882145:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144133632:12345-0@lo:503: 00000100:00100000:0.0:1784938143.882299:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144133632:12345-0@lo:503: Request processed in 153us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.882305:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784938143.882519:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133632:0@lo:503: 00000040:00080000:2.0:1784938143.882981:0:9507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938143.883073:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133760:0@lo:502: 00000100:00100000:2.0:1784938143.883130:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.883161:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8d57900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.883341:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144133760 00000100:00100000:0.0:1784938143.883348:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144133760 00000100:00100000:0.0:1784938143.883384:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784938143.883394:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144133760:12345-0@lo:502: 00000100:00100000:0.0:1784938143.883499:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144133760:12345-0@lo:502: Request processed in 105us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.883507:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784938143.883610:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133760:0@lo:502: 00000040:00080000:2.0:1784938143.883986:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784938143.884016:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784938143.884029:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784938143.884040:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784938143.884053:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784938143.884063:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784938143.884076:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784938143.884090:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784938143.884102:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784938143.884113:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784938143.884127:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784938143.884141:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784938143.884152:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784938143.884946:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784938143.884999:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784938143.885014:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784938143.885027:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784938143.885040:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784938143.885052:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784938143.885066:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784938143.885081:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784938143.885094:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784938143.885105:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784938143.885120:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784938143.885134:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1784938143.885147:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1784938143.885159:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1784938143.886751:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1784938143.886928:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1784938143.886946:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1784938143.887491:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1784938143.887512:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1784938143.887527:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1784938143.887540:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1784938143.887553:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1784938143.887566:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1784938143.887577:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1784938143.887589:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1784938143.887600:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1784938143.887611:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1784938143.887624:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1784938143.887637:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1784938143.888561:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1784938143.888613:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1784938143.888627:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1784938143.888641:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1784938143.890021:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133888:0@lo:502: 00000100:00100000:2.0:1784938143.890123:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.890158:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8d57900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.890297:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144133888 00000100:00100000:0.0:1784938143.890307:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144133888 00000100:00100000:0.0:1784938143.890363:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784938143.890374:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144133888:12345-0@lo:502: 00000100:00100000:0.0:1784938143.890530:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144133888:12345-0@lo:502: Request processed in 157us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.890539:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784938143.890903:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144133888:0@lo:502: 00000040:00080000:2.0:1784938143.890995:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1784938143.891007:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1784938143.898007:0:9524:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784938143.898028:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff910cfcfbb380) 00000020:00000080:2.0:1784938143.898057:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1784938143.898359:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cece6d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784938143.898364:0:9524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cece6d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784938143.898366:0:9524:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cece6d800 3 00010000:00080000:2.0:1784938143.898401:0:9524:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc58d5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1784938143.902865:0:9524:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1784938143.902974:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784938143.903024:0:9524:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784938143.903037:0:9524:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x26783cd1c59ee171 00000100:00080000:2.0:1784938143.903051:0:9524:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:2.0:1784938143.903062:0:9524:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff910bc58d5000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938143.903097:0:9524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc587dc00 x1871643144134016/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938143.903132:0:9524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784938143.903611:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144134144:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938143.903822:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144134656:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938143.903852:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144134016:192.168.203.126@tcp:38: 00000100:00100000:2.0:1784938143.903866:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784938143.903878:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144134272:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938143.903974:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144134784:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938143.904035:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144134400:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938143.904061:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144134912:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938143.904085:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784938143.904093:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144134528:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938143.904122:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144135040:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938143.904547:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938143.904583:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144134144 00000100:00100000:3.0:1784938143.904595:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144134144 00000100:00100000:3.0:1784938143.904685:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00100000:3.0:1784938143.904697:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144134144:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938143.904747:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938143.904766:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144134144:12345-192.168.203.126@tcp:400: Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.904787:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00100000:3.0:1784938143.904813:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144134016 00000100:00100000:3.0:1784938143.904817:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144134016 00000100:00100000:3.0:1784938143.904835:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:3.0:1784938143.904841:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1871643144134016:12345-192.168.203.126@tcp:38: 00000100:00100000:2.0:1784938143.904855:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:3.0:1784938143.904875:0:6513:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 211 last 0 00000100:00100000:2.0:1784938143.904922:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000020:00000080:3.0:1784938143.904924:0:6513:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x26783cd1c59ee178 00000004:00100000:3.0:1784938143.904944:0:6513:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784938143.904993:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00080000:3.0:1784938143.904998:0:6513:0:(import.c:65:import_set_state_nolock()) ffff910bc7166000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938143.905004:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1784938143.905029:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144134528 00000100:00100000:2.0:1784938143.905038:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144134528 00000100:00100000:3.0:1784938143.905073:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871643144134016:12345-192.168.203.126@tcp:38: Request processed in 228us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.905083:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:2.0:1784938143.905100:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:3.0:1784938143.905101:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144134400 00000100:00100000:3.0:1784938143.905108:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144134400 00000100:00100000:2.0:1784938143.905116:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144134528:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938143.905133:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 35 00000100:00100000:3.0:1784938143.905143:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144134400:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938143.905181:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144134528:12345-192.168.203.126@tcp:400: Request processed in 67us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.905190:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:3.0:1784938143.905259:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144134400:12345-192.168.203.126@tcp:400: Request processed in 115us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.905268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 35 00000100:00100000:3.0:1784938143.905299:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938143.905385:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:2.0:1784938143.905400:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc587c000 x1871643144134144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938143.905417:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144134144:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938143.905434:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938143.905552:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938143.905580:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938143.905677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144134272 00000100:00100000:3.0:1784938143.905682:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144134272 00000100:00100000:3.0:1784938143.905711:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:3.0:1784938143.905718:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144134272:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938143.905756:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144134272:12345-192.168.203.126@tcp:400: Request processed in 37us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.905765:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:3.0:1784938143.905790:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144134912 00000100:00100000:3.0:1784938143.905793:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144134912 00010000:00080000:2.0:1784938143.905804:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc587dc00 x1871643144134016/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938143.905828:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144135040 00000100:00100000:2.0:1784938143.905830:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1784938143.905834:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144135040 00000100:00080000:2.0:1784938143.905844:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1784938143.905857:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:3.0:1784938143.905865:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00080000:2.0:1784938143.905869:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:3.0:1784938143.905876:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144134912:12345-192.168.203.126@tcp:400: 00000100:00080000:2.0:1784938143.905876:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784938143.905898:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144134016:192.168.203.126@tcp:38: 00000100:00100000:3.0:1784938143.905920:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144134912:12345-192.168.203.126@tcp:400: Request processed in 41us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.905928:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:3.0:1784938143.905944:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:3.0:1784938143.905950:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144135040:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938143.905982:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144135040:12345-192.168.203.126@tcp:400: Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.905988:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00080000:3.0:1784938143.906130:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938143.906150:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144134656 00000100:00100000:3.0:1784938143.906154:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144134656 00000100:00100000:3.0:1784938143.906181:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144134784 00000100:00100000:3.0:1784938143.906184:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144134784 00000100:00100000:3.0:1784938143.906199:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:3.0:1784938143.906205:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144134656:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938143.906266:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144134656:12345-192.168.203.126@tcp:400: Request processed in 60us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.906272:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:3.0:1784938143.906284:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:3.0:1784938143.906291:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144134784:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938143.906312:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144134784:12345-192.168.203.126@tcp:400: Request processed in 22us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.906318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00080000:3.0:1784938143.906332:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938143.906335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938143.906468:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144134528:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938143.906488:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb15f80 x1871643144135040/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938143.906501:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144135040:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938143.906520:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc587ce00 x1871643144134400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938143.906538:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144134400:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938143.906566:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb14380 x1871643144134912/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938143.906575:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144134912:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938143.906628:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144134272:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938143.906641:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb16680 x1871643144134784/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938143.906663:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144134784:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938143.906677:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb16a00 x1871643144134656/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938143.906685:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144134656:192.168.203.126@tcp:400: 00000020:01000004:2.0:1784938143.910761:0:9524:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784938143.910813:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff910bc7540000) 00000020:00000080:2.0:1784938143.910849:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1784938143.911052:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cece6d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784938143.911058:0:9524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cece6d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784938143.911061:0:9524:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cece6d800 3 00010000:00080000:2.0:1784938143.911098:0:9524:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc1755000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1784938143.913492:0:9524:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:3.0:1784938143.913937:0:9527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1871643144135168:192.168.203.126@tcp:901: 00000100:00100000:3.0:1784938143.914161:0:9527:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd09870c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938143.915573:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938143.915621:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144135168 00000100:00100000:3.0:1784938143.915631:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144135168 00000100:00100000:3.0:1784938143.915710:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:3.0:1784938143.915722:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1871643144135168:12345-192.168.203.126@tcp:901: 00000100:00100000:3.0:1784938143.915981:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1871643144135168:12345-192.168.203.126@tcp:901: Request processed in 260us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.915989:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00080000:3.0:1784938143.916022:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784938143.916356:0:9527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb44700 x1871643144135168/t0(0) o901->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:29/10 lens 248/4320 e 0 to 0 dl 1784938159 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938143.916374:0:9527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1871643144135168:192.168.203.126@tcp:901: 00000020:00000080:2.0:1784938143.926097:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1784938143.926735:0:9524:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938143.926762:0:9524:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x26783cd1c59ee186 00000100:00080000:3.0:1784938143.926898:0:9524:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:3.0:1784938143.926916:0:9524:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff910bc1755000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938143.926970:0:9524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb44700 x1871643144135296/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938143.927001:0:9524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1784938143.927085:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1871643144135296:192.168.203.126@tcp:38: 00000100:00100000:3.0:1784938143.927703:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938143.927743:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144135296 00000100:00100000:3.0:1784938143.927756:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144135296 00000100:00100000:3.0:1784938143.927935:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:3.0:1784938143.927942:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1871643144135296:12345-192.168.203.126@tcp:38: 00010000:00080000:3.0:1784938143.927977:0:6512:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:3.0:1784938143.928013:0:6512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x26783cd1c59ee18d 00000004:00100000:3.0:1784938143.928029:0:6512:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:0.0:1784938143.928036:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00080000:3.0:1784938143.928077:0:6512:0:(import.c:65:import_set_state_nolock()) ffff910bc7160000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938143.928136:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871643144135296:12345-192.168.203.126@tcp:38: Request processed in 193us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.928144:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00010000:00080000:3.0:1784938143.928287:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb44700 x1871643144135296/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938143.928305:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938143.928313:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1784938143.928321:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784938143.928327:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784938143.928330:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc1755000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784938143.928336:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1871643144135296:192.168.203.126@tcp:38: 00000020:01000000:3.0:1784938143.928526:0:9507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1784938143.928566:0:9507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938143.928587:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.928597:0:9507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784938143.928684:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784938143.928687:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938143.928688:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938143.928690:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938143.928691:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938143.928693:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938143.928695:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938143.928696:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938143.928698:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938143.928700:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938143.928702:0:9507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938143.928706:0:9507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1784938143.928709:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938143.928711:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938143.928713:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938143.928714:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938143.928715:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938143.928722:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938143.928724:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938143.928725:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938143.928726:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938143.928727:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938143.928728:0:9507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938143.928758:0:9507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784938143.928774:0:9507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144135424:0@lo:253: 00000100:00100000:3.0:1784938143.928840:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.928882:0:9507:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1587600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.929166:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144135424 00000100:00100000:0.0:1784938143.929368:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144135424 00000100:00100000:0.0:1784938143.929476:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784938143.929494:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144135424:12345-0@lo:253: 20000000:01000000:0.0:1784938143.929531:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784938143.929549:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784938143.950879:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784938143.950935:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784938143.951250:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9507:x1871643144135424:12345-0@lo:253: Request processed in 21762us (22406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.951259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784938143.951384:0:9507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7782ae5c-cb83-4240-bccc-1dc097db054d:9507:1871643144135424:0@lo:253: 10000000:01000000:3.0:1784938143.951395:0:9507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784938143.951397:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938143.951399:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784938143.951400:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938143.951401:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938143.951402:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938143.951403:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938143.951404:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938143.951405:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784938143.951406:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784938143.951407:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938143.951408:0:9507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784938143.951424:0:9507:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1784938143.953688:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784938143.953699:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938143.953987:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.954015:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee083 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.954024:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee0c9 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.954032:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.954111:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee0c9 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.954134:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee0c9 expref: 16 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.954186:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144135552:0@lo:104: 00000100:00100000:2.0:1784938143.954360:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938143.954443:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee083 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.954457:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee083 expref: 16 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938143.954481:0:6528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144135680:0@lo:104: 00000100:00100000:2.0:1784938143.954509:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938143.954537:0:6528:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.954563:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144135552 00000100:00100000:0.0:1784938143.954571:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144135552 00000100:00100000:0.0:1784938143.954612:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144135680 00000100:00100000:0.0:1784938143.954614:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144135680 00000100:00100000:0.0:1784938143.954628:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784938143.954635:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6528:x1871643144135552:12345-0@lo:104: 00010000:00010000:0.0:1784938143.954665:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.954733:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938143.954739:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:6528:x1871643144135552:12345-0@lo:104: Request processed in 105us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.954746:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784938143.954972:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938143.954979:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6528:x1871643144135680:12345-0@lo:104: 00010000:00010000:0.0:1784938143.954988:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955025:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784938143.955030:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:6528:x1871643144135680:12345-0@lo:104: Request processed in 52us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.955035:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1784938143.955052:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938143.955058:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938143.955111:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144135552:0@lo:104: 00000100:00100000:2.0:1784938143.955120:0:6528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1871643144135680:0@lo:104: 00010000:00010000:2.0:1784938143.955141:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955146:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938143.955151:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955160:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938143.955167:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938143.955173:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938143.955238:0:7463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955246:0:7463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938143.955270:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955277:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b76e00/0x26783cd1c59ee0c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee0d0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955419:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938143.955424:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955431:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0000 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938143.955434:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955451:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938143.955457:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938143.955462:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938143.955550:0:7463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955558:0:7463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938143.955566:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955571:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee08a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955585:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938143.955586:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938143.955588:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938143.955594:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938143.955604:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144135936:0@lo:103: 00000100:00100000:0.0:1784938143.955639:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.955739:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938143.955746:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144135808:0@lo:103: 00000100:00100000:0.0:1784938143.955848:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.955876:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144135936 00000100:00100000:0.0:1784938143.955881:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144135936 00010000:00010000:0.0:1784938143.955902:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee083 expref: 17 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.955932:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144135808 00000100:00100000:0.0:1784938143.955935:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144135808 00010000:00010000:0.0:1784938143.955949:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee0c9 expref: 18 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.955966:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784938143.955972:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:3643:x1871643144135936:12345-0@lo:103: 00010000:00010000:0.0:1784938143.955982:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938143.955987:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee083 expref: 18 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.955995:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee083 expref: 18 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956008:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee08a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee083 expref: 18 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956020:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938143.956049:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:3643:x1871643144135936:12345-0@lo:103: Request processed in 77us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.956056:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784938143.956072:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938143.956159:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:3643:x1871643144135808:12345-0@lo:103: 00010000:00010000:0.0:1784938143.956168:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938143.956173:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee0c9 expref: 16 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956183:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee0c9 expref: 16 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956364:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee0d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee0c9 expref: 16 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956376:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956385:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784938143.956400:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012153715s 00010000:00010000:0.0:1784938143.956404:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956411:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956417:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956424:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956430:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938143.956433:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956441:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956462:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.956679:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.956689:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956738:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee194 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.956753:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938143.956863:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:3643:x1871643144135808:12345-0@lo:103: Request processed in 705us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.956870:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938143.956912:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144135808:0@lo:103: 00000100:00100000:0.0:1784938143.956920:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144135936:0@lo:103: 00080000:10000000:3.0:1784938143.960061:0:9507:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1784938143.960265:0:9507:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1784938143.960458:0:9507:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1784938143.960655:0:9507:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1784938143.960864:0:9507:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1784938143.961073:0:9507:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1784938143.972641:0:9507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1784938143.996342:0:9507:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784938143.996354:0:9507:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784938143.996403:0:9507:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784938143.996472:0:9507:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784938143.996492:0:9507:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1784938143.996513:0:9507:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1784938144.000527:0:9507:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938144.000827:0:9507:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1784938144.352134:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784938145.238817:0:9581:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938145.239149:0:9581:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784938145.376334:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938145.440760:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144136064:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938145.440804:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144136192:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938145.447848:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938145.447919:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938145.447960:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144136064 00000100:00100000:2.0:1784938145.447971:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144136064 00000100:00100000:2.0:1784938145.448039:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144136192 00000100:00100000:2.0:1784938145.448043:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144136192 00000100:00100000:2.0:1784938145.448063:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:2.0:1784938145.448074:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144136064:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938145.448124:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938145.448174:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144136064:12345-192.168.203.126@tcp:13: Request processed in 103us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938145.448182:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:2.0:1784938145.448203:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:2.0:1784938145.448209:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144136192:12345-192.168.203.126@tcp:13: 00010000:00080000:1.0:1784938145.448501:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4835180 x1871643144136064/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938145.448530:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144136064:192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938145.449451:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938145.449525:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144136192:12345-192.168.203.126@tcp:13: Request processed in 1312us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938145.449534:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00080000:2.0:1784938145.449582:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938145.454087:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb16a00 x1871643144136192/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938145.454951:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144136192:192.168.203.126@tcp:13: 00010000:00010000:0.0:1784938146.400111:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938146.471077:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144136320:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938146.471381:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938146.471412:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144136320 00000100:00100000:2.0:1784938146.471419:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144136320 00000100:00100000:2.0:1784938146.471469:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 51 00000100:00100000:2.0:1784938146.471477:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144136320:12345-192.168.203.126@tcp:41: 00000004:00000024:2.0:1784938146.471525:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1784938146.471571:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144136320:12345-192.168.203.126@tcp:41: Request processed in 94us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938146.471579:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 51 00000100:00100000:2.0:1784938146.473065:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144136320:192.168.203.126@tcp:41: 00010000:00010000:3.0:1784938147.426550:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938148.000028:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938148.000054:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144136448:192.168.203.126@tcp:41: 00000100:00100000:1.0:1784938148.000334:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938148.000364:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144136448 00000100:00100000:1.0:1784938148.000371:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144136448 00000100:00100000:1.0:1784938148.000425:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:1.0:1784938148.000434:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144136448:12345-192.168.203.126@tcp:41: 00000004:00000024:1.0:1784938148.000469:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1784938148.000507:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144136448:12345-192.168.203.126@tcp:41: Request processed in 74us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938148.000515:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:1.0:1784938148.000820:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144136448:192.168.203.126@tcp:41: 00010000:00010000:3.0:1784938148.451891:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784938149.023356:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784938149.023365:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cfd213000 from 39 10000000:01000000:2.0:1784938149.023371:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938149.023419:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.023432:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.023444:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938149.023467:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144136576:0@lo:101: 00000100:00100000:2.0:1784938149.023537:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.023591:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.023625:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144136576 00000100:00100000:2.0:1784938149.023632:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144136576 00000100:00100000:2.0:1784938149.023678:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784938149.023687:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144136576:12345-0@lo:101: 00010000:00010000:2.0:1784938149.023700:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938149.023712:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee19b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.023752:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee19b expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.023762:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee19b expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.023772:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1600, rc 0) 00000100:00100000:2.0:1784938149.023812:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144136576:12345-0@lo:101: Request processed in 126us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.023818:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784938149.023865:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144136576:0@lo:101: 00010000:00010000:2.0:1784938149.023878:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.023886:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938149.024159:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144136704:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024249:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144137216:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024281:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144137728:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024307:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784938149.024313:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144136832:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024336:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144137344:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024357:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144137856:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024389:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144136960:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024414:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144137472:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024434:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938149.024439:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144137088:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024458:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144137600:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.024698:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024762:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024782:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024799:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024817:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024832:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024843:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024857:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024876:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024894:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.024934:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144136704 00000100:00100000:3.0:1784938149.024946:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144136704 00000100:00100000:3.0:1784938149.024976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144137216 00000100:00100000:3.0:1784938149.024979:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144137216 00000100:00100000:3.0:1784938149.024999:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144137728 00000100:00100000:3.0:1784938149.025001:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144137728 00000100:00100000:3.0:1784938149.025013:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144137344 00000100:00100000:3.0:1784938149.025015:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144137344 00000100:00100000:3.0:1784938149.025029:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144137856 00000100:00100000:3.0:1784938149.025031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144137856 00000100:00100000:3.0:1784938149.025042:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144136960 00000100:00100000:3.0:1784938149.025045:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144136960 00000100:00100000:3.0:1784938149.025058:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:3.0:1784938149.025065:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144136704:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025106:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144136704:12345-192.168.203.126@tcp:400: Request processed in 40us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025113:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:3.0:1784938149.025127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:3.0:1784938149.025133:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144137216:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025158:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144137216:12345-192.168.203.126@tcp:400: Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025165:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:3.0:1784938149.025176:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:3.0:1784938149.025182:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144137728:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025203:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144137728:12345-192.168.203.126@tcp:400: Request processed in 21us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025209:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:3.0:1784938149.025238:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:3.0:1784938149.025245:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144137344:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025275:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144137344:12345-192.168.203.126@tcp:400: Request processed in 30us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025282:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:3.0:1784938149.025293:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:3.0:1784938149.025299:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144137856:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025318:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144137856:12345-192.168.203.126@tcp:400: Request processed in 19us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025325:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:3.0:1784938149.025335:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:3.0:1784938149.025340:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144136960:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144136960:12345-192.168.203.126@tcp:400: Request processed in 17us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:3.0:1784938149.025390:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144137472 00000100:00100000:3.0:1784938149.025393:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144137472 00000100:00100000:3.0:1784938149.025415:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144137600 00000100:00100000:3.0:1784938149.025418:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144137600 00000100:00100000:3.0:1784938149.025435:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:3.0:1784938149.025441:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144137472:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025463:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144137472:12345-192.168.203.126@tcp:400: Request processed in 23us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025469:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:3.0:1784938149.025479:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:3.0:1784938149.025485:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144137600:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025504:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144137600:12345-192.168.203.126@tcp:400: Request processed in 19us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025515:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:3.0:1784938149.025532:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144136832 00000100:00100000:3.0:1784938149.025536:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144136832 00000100:00100000:3.0:1784938149.025555:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144137088 00000100:00100000:3.0:1784938149.025558:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144137088 00000100:00100000:3.0:1784938149.025569:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:3.0:1784938149.025574:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144136832:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025624:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144136832:12345-192.168.203.126@tcp:400: Request processed in 38us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025631:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:3.0:1784938149.025644:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:3.0:1784938149.025650:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144137088:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.025669:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144137088:12345-192.168.203.126@tcp:400: Request processed in 19us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.025674:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:3.0:1784938149.025930:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144137088:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938149.025944:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c4a80 x1871643144137600/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.025955:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144137600:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938149.025965:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c4380 x1871643144136960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.025973:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144136960:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938149.025981:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c6680 x1871643144137472/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.025997:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144137472:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938149.026036:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144136832:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938149.026048:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c5f80 x1871643144137344/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.026056:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144137344:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938149.026066:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c7480 x1871643144137856/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.026074:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144137856:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938149.026085:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb44700 x1871643144136704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.026093:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144136704:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938149.026103:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c4e00 x1871643144137216/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.026110:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144137216:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938149.026120:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c7b80 x1871643144137728/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.026128:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144137728:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938149.027152:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144137984:0@lo:501: 00000100:00100000:2.0:1784938149.027210:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.027340:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4dd80 going to sleep for 11 seconds 00000100:00080000:2.0:1784938149.027370:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938149.027376:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938149.027379:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938149.029063:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144137984 00000100:00100000:3.0:1784938149.029074:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144137984 00000100:00100000:3.0:1784938149.029130:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784938149.029140:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144137984:12345-0@lo:501: 00000100:00100000:3.0:1784938149.031164:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144137984:12345-0@lo:501: Request processed in 2017us (3944us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.031177:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784938149.035471:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144137984:0@lo:501: 00000100:00100000:3.0:1784938149.035546:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144138112:0@lo:503: 00000100:00100000:3.0:1784938149.035630:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938149.035678:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938149.035802:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144138112 00000100:00100000:0.0:1784938149.035809:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144138112 00000100:00100000:0.0:1784938149.035863:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784938149.035872:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144138112:12345-0@lo:503: 00000100:00100000:0.0:1784938149.036429:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144138112:12345-0@lo:503: Request processed in 555us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938149.036437:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784938149.037428:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144138112:0@lo:503: 00000100:00100000:3.0:1784938149.038410:0:9803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9803:1871643144138240:0@lo:502: 00000100:00100000:3.0:1784938149.038472:0:9803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938149.038571:0:9803:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938149.038637:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144138240 00000100:00100000:0.0:1784938149.038644:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144138240 00000100:00100000:0.0:1784938149.038691:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784938149.038700:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9803:x1871643144138240:12345-0@lo:502: 00000100:00100000:0.0:1784938149.038796:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9803:x1871643144138240:12345-0@lo:502: Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938149.038804:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784938149.039405:0:9803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9803:1871643144138240:0@lo:502: 00000100:00100000:3.0:1784938149.039456:0:9803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9803:1871643144138368:0@lo:502: 00000100:00100000:3.0:1784938149.039699:0:9803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938149.039731:0:9803:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938149.039983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144138368 00000100:00100000:0.0:1784938149.039988:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144138368 00000100:00100000:0.0:1784938149.040343:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784938149.040353:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9803:x1871643144138368:12345-0@lo:502: 00000100:00100000:0.0:1784938149.040465:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:9803:x1871643144138368:12345-0@lo:502: Request processed in 113us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938149.040472:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784938149.040839:0:9803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9803:1871643144138368:0@lo:502: 00000040:00080000:3.0:1784938149.040869:0:9803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1784938149.041867:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1784938149.041959:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938149.041970:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.041982:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938149.041992:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784938149.041995:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1784938149.041998:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784938149.042038:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.042047:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.042058:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938149.042076:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144138496:0@lo:101: 00000100:00100000:0.0:1784938149.042119:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.042155:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.042340:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144138496 00000100:00100000:3.0:1784938149.042347:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144138496 00000100:00100000:3.0:1784938149.042382:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784938149.042389:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144138496:12345-0@lo:101: 00010000:00010000:3.0:1784938149.042401:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938149.042413:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee1a9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938149.042446:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee1a9 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938149.042455:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee1a9 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938149.042464:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b600, rc 0) 00000100:00100000:3.0:1784938149.042498:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144138496:12345-0@lo:101: Request processed in 109us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.042505:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784938149.043688:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144138496:0@lo:101: 00010000:00010000:0.0:1784938149.043709:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.043721:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938149.043789:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144138624:0@lo:501: 00000100:00100000:0.0:1784938149.043826:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.043865:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.045564:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144138624 00000100:00100000:2.0:1784938149.045578:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144138624 00000100:00100000:2.0:1784938149.045642:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784938149.045652:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144138624:12345-0@lo:501: 00000100:00100000:2.0:1784938149.045819:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144138624:12345-0@lo:501: Request processed in 168us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.045827:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784938149.046122:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144138624:0@lo:501: 00000100:00100000:0.0:1784938149.046167:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144138752:0@lo:503: 00000100:00100000:0.0:1784938149.046317:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.046348:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.046401:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144138752 00000100:00100000:2.0:1784938149.046406:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144138752 00000100:00100000:2.0:1784938149.046438:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784938149.046445:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144138752:12345-0@lo:503: 00000100:00100000:2.0:1784938149.046668:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144138752:12345-0@lo:503: Request processed in 222us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.046675:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784938149.059874:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144138752:0@lo:503: 00000100:00100000:0.0:1784938149.061443:0:9804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9804:1871643144138880:0@lo:502: 00000100:00100000:0.0:1784938149.061539:0:9804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.062637:0:9804:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.065589:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144138880 00000100:00100000:2.0:1784938149.065601:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144138880 00000100:00100000:2.0:1784938149.065662:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784938149.065670:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9804:x1871643144138880:12345-0@lo:502: 00000100:00100000:2.0:1784938149.065834:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9804:x1871643144138880:12345-0@lo:502: Request processed in 164us (4295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.065842:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784938149.066455:0:9804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9804:1871643144138880:0@lo:502: 00000020:01000000:0.0:1784938149.066507:0:9804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938149.066516:0:9804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938149.066518:0:9804:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938149.066525:0:9804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938149.066526:0:9804:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784938149.066554:0:9804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9804:1871643144139008:0@lo:502: 00000100:00100000:0.0:1784938149.066604:0:9804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.066659:0:9804:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.067832:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144139008 00000100:00100000:2.0:1784938149.067841:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144139008 00000100:00100000:2.0:1784938149.067887:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784938149.067902:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9804:x1871643144139008:12345-0@lo:502: 00000100:00100000:2.0:1784938149.068352:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+17:9804:x1871643144139008:12345-0@lo:502: Request processed in 456us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.068360:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784938149.068880:0:9804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9804:1871643144139008:0@lo:502: 00000020:01000000:0.0:1784938149.068921:0:9804:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938149.068929:0:9804:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938149.068931:0:9804:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784938149.068937:0:9804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1784938149.070576:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1784938149.070606:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784938149.070625:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.070645:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938149.070656:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784938149.070658:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cc481d800 from 39 10000000:01000000:2.0:1784938149.070662:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938149.070694:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.070703:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.070713:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938149.070733:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139136:0@lo:101: 00000100:00100000:2.0:1784938149.070787:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.070914:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd16c000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938149.071100:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144139136 00000100:00100000:0.0:1784938149.071107:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144139136 00000100:00100000:0.0:1784938149.071154:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784938149.071162:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144139136:12345-0@lo:101: 00010000:00010000:0.0:1784938149.071174:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938149.071187:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee1b7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.071207:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee1b7 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.071236:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee1b7 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.071255:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77400, rc 0) 00000100:00100000:0.0:1784938149.071298:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144139136:12345-0@lo:101: Request processed in 137us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938149.071305:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784938149.071348:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139136:0@lo:101: 00010000:00010000:0.0:1784938149.071361:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.071370:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938149.071434:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139264:0@lo:501: 00000100:00100000:0.0:1784938149.071460:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.071475:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc67126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938149.071499:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144139264 00000100:00100000:0.0:1784938149.071503:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144139264 00000100:00100000:0.0:1784938149.071526:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784938149.071532:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144139264:12345-0@lo:501: 00000100:00100000:0.0:1784938149.071659:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144139264:12345-0@lo:501: Request processed in 126us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938149.071667:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784938149.071696:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139264:0@lo:501: 00000100:00100000:0.0:1784938149.071722:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139392:0@lo:503: 00000100:00100000:0.0:1784938149.071761:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.071773:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc67126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938149.071784:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144139392 00000100:00100000:0.0:1784938149.071787:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144139392 00000100:00100000:0.0:1784938149.071804:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784938149.071810:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144139392:12345-0@lo:503: 00000100:00100000:0.0:1784938149.071906:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144139392:12345-0@lo:503: Request processed in 95us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938149.071913:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784938149.071952:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139392:0@lo:503: 00000100:00100000:3.0:1784938149.087372:0:9805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9805:1871643144139520:0@lo:502: 00000100:00100000:3.0:1784938149.087458:0:9805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938149.087513:0:9805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b7900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.088348:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144139520 00000100:00100000:1.0:1784938149.088358:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144139520 00000100:00100000:1.0:1784938149.088404:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784938149.088413:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:9805:x1871643144139520:12345-0@lo:502: 00000100:00100000:1.0:1784938149.088799:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:9805:x1871643144139520:12345-0@lo:502: Request processed in 386us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.088808:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784938149.088890:0:9805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9805:1871643144139520:0@lo:502: 00000100:00100000:1.0:1784938149.088954:0:9805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9805:1871643144139648:0@lo:502: 00000100:00100000:1.0:1784938149.088994:0:9805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938149.089029:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144139648 00000100:00100000:1.0:1784938149.089034:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144139648 00000100:00100000:1.0:1784938149.089058:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784938149.089064:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:9805:x1871643144139648:12345-0@lo:502: 00000100:00100000:1.0:1784938149.089124:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+18:9805:x1871643144139648:12345-0@lo:502: Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.089130:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784938149.089164:0:9805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5bda80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.089176:0:9805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9805:1871643144139648:0@lo:502: 00000040:00080000:1.0:1784938149.089192:0:9805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1784938149.093259:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1784938149.093299:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938149.093318:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.093331:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938149.093341:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938149.093344:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cc481d800 from 6 10000000:01000000:0.0:1784938149.093346:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938149.093384:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.093393:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.093405:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938149.093425:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139776:0@lo:101: 00000100:00100000:0.0:1784938149.093491:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.093520:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.093717:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144139776 00000100:00100000:1.0:1784938149.093725:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144139776 00000100:00100000:1.0:1784938149.093775:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784938149.093784:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144139776:12345-0@lo:101: 00010000:00010000:1.0:1784938149.093796:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938149.093811:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1400/0x26783cd1c59ee1cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee1c5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.093832:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1400/0x26783cd1c59ee1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee1c5 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.093843:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1400/0x26783cd1c59ee1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee1c5 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.093852:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1400, rc 0) 00000100:00100000:1.0:1784938149.093907:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144139776:12345-0@lo:101: Request processed in 123us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.093914:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784938149.095354:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139776:0@lo:101: 00010000:00010000:0.0:1784938149.095373:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.095384:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938149.095441:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139904:0@lo:256: 00000100:00100000:0.0:1784938149.095488:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.095504:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.095566:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144139904 00000100:00100000:1.0:1784938149.095571:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144139904 00000100:00100000:1.0:1784938149.095618:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784938149.095627:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144139904:12345-0@lo:256: 20000000:01000000:1.0:1784938149.095644:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938149.095661:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938149.095664:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1784938149.095753:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144139904:12345-0@lo:256: Request processed in 126us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.095761:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784938149.095823:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144139904:0@lo:256: 10000000:01000000:0.0:1784938149.095867:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784938149.095874:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.095881:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938149.095888:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784938149.095891:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1784938149.095894:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784938149.095922:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.095929:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.095937:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938149.095949:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144140032:0@lo:101: 00000100:00100000:0.0:1784938149.095972:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.095992:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.096078:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144140032 00000100:00100000:1.0:1784938149.096083:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144140032 00000100:00100000:1.0:1784938149.096112:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784938149.096119:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144140032:12345-0@lo:101: 00010000:00010000:1.0:1784938149.096127:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938149.096139:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee1d3 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.096155:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee1d3 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.096164:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee1d3 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.096172:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1a00, rc 0) 00000100:00100000:1.0:1784938149.096200:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144140032:12345-0@lo:101: Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.096234:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784938149.096271:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144140032:0@lo:101: 00010000:00010000:1.0:1784938149.096282:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.096290:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938149.096338:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144140160:0@lo:501: 00000100:00100000:1.0:1784938149.096361:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938149.096375:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.096385:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144140160 00000100:00100000:1.0:1784938149.096388:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144140160 00000100:00100000:1.0:1784938149.096407:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784938149.096413:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144140160:12345-0@lo:501: 00000100:00100000:1.0:1784938149.096513:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144140160:12345-0@lo:501: Request processed in 99us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.096520:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784938149.096546:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144140160:0@lo:501: 00000100:00100000:1.0:1784938149.096570:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144140288:0@lo:503: 00000100:00100000:1.0:1784938149.096607:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938149.096632:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.096643:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144140288 00000100:00100000:1.0:1784938149.096647:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144140288 00000100:00100000:1.0:1784938149.096666:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1784938149.096671:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144140288:12345-0@lo:503: 00000100:00100000:1.0:1784938149.096753:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144140288:12345-0@lo:503: Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.096760:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1784938149.096795:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144140288:0@lo:503: 00000100:00100000:1.0:1784938149.098205:0:9808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9808:1871643144140416:0@lo:502: 00000100:00100000:1.0:1784938149.098285:0:9808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938149.098314:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144140416 00000100:00100000:1.0:1784938149.098318:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144140416 00000100:00100000:1.0:1784938149.098349:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784938149.098355:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:9808:x1871643144140416:12345-0@lo:502: 00000100:00100000:1.0:1784938149.098449:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:9808:x1871643144140416:12345-0@lo:502: Request processed in 93us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.098456:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784938149.098491:0:9808:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.098508:0:9808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9808:1871643144140416:0@lo:502: 00000020:01000000:1.0:1784938149.098530:0:9808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938149.098537:0:9808:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784938149.098543:0:9808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938149.098545:0:9808:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784938149.098550:0:9808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938149.098554:0:9808:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:1.0:1784938149.098574:0:9808:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784938149.098577:0:9808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938149.098592:0:9808:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff910cfd203380) 00000020:00000080:1.0:1784938149.098625:0:9808:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1784938149.098631:0:9808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938149.098722:0:9808:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1784938149.098733:0:9808:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784938149.098739:0:9808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59ee1e8 00010000:00080000:1.0:1784938149.098769:0:9808:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc7c63800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1784938149.102850:0:9808:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1784938149.103084:0:9808:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1784938149.103097:0:9808:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1784938149.104034:0:9808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938149.104191:0:9808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938149.104351:0:9808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1784938149.104440:0:9808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1784938149.116762:0:9809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938149.116771:0:9809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784938149.119957:0:9808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784938149.119972:0:9808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784938149.120019:0:9808:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784938149.120046:0:9808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ee1ef 00000100:00080000:2.0:1784938149.120058:0:9808:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:2.0:1784938149.120070:0:9808:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff910bc7c63800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938149.120106:0:9808:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc587dc00 x1871643144140544/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938149.120143:0:9808:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784938149.120198:0:9808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938149.120202:0:9808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938149.120204:0:9808:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784938149.120206:0:9808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938149.120210:0:9808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938149.120234:0:9808:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938149.120247:0:9808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938149.120249:0:9808:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784938149.120275:0:9808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9808:1871643144140672:0@lo:502: 00000100:00100000:2.0:1784938149.120344:0:9808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.120376:0:9808:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd16c300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.120591:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144140544:192.168.203.126@tcp:8: 00000100:00100000:1.0:1784938149.120766:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144140672 00000100:00100000:1.0:1784938149.120774:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144140672 00000100:00100000:1.0:1784938149.120812:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784938149.120821:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:9808:x1871643144140672:12345-0@lo:502: 00000100:00100000:1.0:1784938149.120960:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:9808:x1871643144140672:12345-0@lo:502: Request processed in 139us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.120968:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784938149.121019:0:9808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9808:1871643144140672:0@lo:502: 00000020:01000000:1.0:1784938149.121044:0:9808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938149.121049:0:9808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938149.121050:0:9808:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784938149.121054:0:9808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1784938149.121107:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1784938149.121128:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784938149.121138:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.121149:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938149.121169:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938149.121172:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cca3c9000 from 39 10000000:01000000:1.0:1784938149.121174:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938149.121196:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.121204:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.121235:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938149.121259:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144140800:0@lo:101: 00000100:00100000:1.0:1784938149.121287:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.121529:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938149.121557:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144140544 00000100:00100000:2.0:1784938149.121562:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144140544 00000100:00100000:2.0:1784938149.121586:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:2.0:1784938149.121591:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1871643144140544:12345-192.168.203.126@tcp:8: 00010000:00080000:2.0:1784938149.121626:0:8429:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1784938149.121651:0:8429:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ee1fd 00002000:00100000:2.0:1784938149.121663:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff910bc67e3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1784938149.121668:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1784938149.121671:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784938149.121729:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784938149.121960:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1784938149.121989:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910bc67e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938149.122035:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1871643144140544:12345-192.168.203.126@tcp:8: Request processed in 442us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.122052:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00010000:00080000:2.0:1784938149.122191:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587dc00 x1871643144140544/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938149.122202:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938149.122209:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1784938149.122541:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784938149.122549:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784938149.122552:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc7c63800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784938149.122566:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784938149.122572:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144140544:192.168.203.126@tcp:8: 00000004:00080000:2.0:1784938149.122600:0:9809:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784938149.122664:0:9809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 217154448789ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784938149.122671:0:9809:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1784938149.125028:0:9810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9810:1871643144140928:192.168.203.126@tcp:700: 00000100:00100000:2.0:1784938149.125262:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938149.125298:0:9810:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd16c300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.128006:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144140928 00000100:00100000:1.0:1784938149.128021:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144140928 00000100:00100000:1.0:1784938149.128093:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:1.0:1784938149.128103:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9810:x1871643144140928:12345-192.168.203.126@tcp:700: 00000100:00100000:1.0:1784938149.128158:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8438:1871643144141056:192.168.203.126@tcp:700: 00000100:00100000:1.0:1784938149.128252:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5bd240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.128883:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938149.129098:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd498840 going to sleep for 11 seconds 00000100:00080000:2.0:1784938149.129561:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938149.130800:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144141056 00000100:00100000:2.0:1784938149.130811:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144141056 00000100:00100000:2.0:1784938149.130881:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:2.0:1784938149.130891:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8438:x1871643144141056:12345-192.168.203.126@tcp:700: 00000004:00080000:2.0:1784938149.136144:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1784938149.136272:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144140800 00000100:00100000:3.0:1784938149.136283:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144140800 00000100:00100000:3.0:1784938149.136335:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784938149.136346:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144140800:12345-0@lo:101: 00010000:00010000:3.0:1784938149.136364:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938149.136382:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee1f6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938149.136409:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee1f6 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938149.136432:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee1f6 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938149.137208:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b800, rc 0) 00000100:00100000:3.0:1784938149.137375:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144140800:12345-0@lo:101: Request processed in 1029us (16085us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.137383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784938149.139727:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144140800:0@lo:101: 00010000:00010000:3.0:1784938149.139755:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938149.139768:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938149.139867:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141184:0@lo:501: 00000100:00100000:3.0:1784938149.139931:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938149.139972:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144141184 00000100:00100000:3.0:1784938149.139977:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144141184 00000100:00100000:3.0:1784938149.140014:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784938149.140022:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144141184:12345-0@lo:501: 00000100:00100000:3.0:1784938149.140128:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144141184:12345-0@lo:501: Request processed in 107us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.140136:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784938149.140175:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.140186:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141184:0@lo:501: 00000100:00100000:3.0:1784938149.140211:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141312:0@lo:503: 00000100:00100000:3.0:1784938149.140262:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938149.140279:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144141312 00000100:00100000:3.0:1784938149.140288:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144141312 00000100:00100000:3.0:1784938149.140307:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784938149.140313:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144141312:12345-0@lo:503: 00000100:00100000:3.0:1784938149.140381:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144141312:12345-0@lo:503: Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.140389:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784938149.140417:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.140442:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141312:0@lo:503: 00000100:00100000:2.0:1784938149.158005:0:9811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9811:1871643144141440:0@lo:502: 00000100:00100000:2.0:1784938149.158118:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.158192:0:9811:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd16c240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.158362:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144141440 00000100:00100000:3.0:1784938149.158377:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144141440 00000100:00100000:3.0:1784938149.158444:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784938149.158453:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:9811:x1871643144141440:12345-0@lo:502: 00000100:00100000:3.0:1784938149.158629:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:9811:x1871643144141440:12345-0@lo:502: Request processed in 176us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.158638:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784938149.158943:0:9811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9811:1871643144141440:0@lo:502: 00000100:00100000:2.0:1784938149.159014:0:9811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9811:1871643144141568:0@lo:502: 00000100:00100000:2.0:1784938149.159058:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.160053:0:9811:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd16c240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.160100:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144141568 00000100:00100000:3.0:1784938149.160113:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144141568 00000100:00100000:3.0:1784938149.160184:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784938149.160194:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:9811:x1871643144141568:12345-0@lo:502: 00000100:00100000:3.0:1784938149.160353:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:9811:x1871643144141568:12345-0@lo:502: Request processed in 160us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.160361:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784938149.160522:0:9811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9811:1871643144141568:0@lo:502: 00000040:00080000:2.0:1784938149.160563:0:9811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 40000000:02000000:3.0:1784938149.160647:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:01000000:0.0:1784938149.161075:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1784938149.161108:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938149.161326:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.161353:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938149.161364:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938149.161366:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cca3c9000 from 6 10000000:01000000:0.0:1784938149.161369:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938149.161401:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.161410:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.161544:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938149.161567:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141696:0@lo:101: 00000100:00100000:0.0:1784938149.161625:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.161656:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.162207:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144141696 00000100:00100000:2.0:1784938149.162232:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144141696 00000100:00100000:2.0:1784938149.162455:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784938149.162468:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144141696:12345-0@lo:101: 00010000:00010000:2.0:1784938149.162488:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938149.162511:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d0600/0x26783cd1c59ee212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee20b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.162549:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d0600/0x26783cd1c59ee212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee20b expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.162563:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d0600/0x26783cd1c59ee212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee20b expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.162573:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d0600, rc 0) 00000100:00100000:2.0:1784938149.162665:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144141696:12345-0@lo:101: Request processed in 199us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.162672:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784938149.166029:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141696:0@lo:101: 00010000:00010000:0.0:1784938149.166056:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938149.166068:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938149.166844:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141824:0@lo:256: 00000100:00100000:0.0:1784938149.166911:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.166959:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.170731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144141824 00000100:00100000:2.0:1784938149.170752:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144141824 00000100:00100000:2.0:1784938149.170851:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784938149.170863:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144141824:12345-0@lo:256: 20000000:01000000:2.0:1784938149.170913:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784938149.170933:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784938149.170936:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1784938149.171108:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144141824:12345-0@lo:256: Request processed in 246us (4194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.171116:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784938149.171190:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141824:0@lo:256: 10000000:01000000:2.0:1784938149.171282:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784938149.171293:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.171307:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938149.171319:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784938149.171322:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1784938149.171325:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784938149.171365:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.171375:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.171385:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938149.171410:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141952:0@lo:101: 00000100:00100000:2.0:1784938149.171449:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.171485:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc2afc240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.171509:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144141952 00000100:00100000:2.0:1784938149.171513:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144141952 00000100:00100000:2.0:1784938149.171542:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784938149.171549:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144141952:12345-0@lo:101: 00010000:00010000:2.0:1784938149.171560:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938149.171575:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee219 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.171601:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee219 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.171627:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee219 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.171638:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1400, rc 0) 00000100:00100000:2.0:1784938149.171669:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144141952:12345-0@lo:101: Request processed in 120us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.171675:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784938149.171706:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144141952:0@lo:101: 00010000:00010000:2.0:1784938149.171719:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.171729:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938149.171795:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144142080:0@lo:501: 00000100:00100000:2.0:1784938149.171821:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.171834:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc2afc240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.171846:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144142080 00000100:00100000:2.0:1784938149.171856:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144142080 00000100:00100000:2.0:1784938149.171879:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784938149.171885:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144142080:12345-0@lo:501: 00000100:00100000:2.0:1784938149.172025:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144142080:12345-0@lo:501: Request processed in 139us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.172032:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784938149.172063:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144142080:0@lo:501: 00000100:00100000:2.0:1784938149.172091:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144142208:0@lo:503: 00000100:00100000:2.0:1784938149.172131:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.172144:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910ccca5f180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.172155:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144142208 00000100:00100000:2.0:1784938149.172158:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144142208 00000100:00100000:2.0:1784938149.172178:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784938149.172184:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144142208:12345-0@lo:503: 00000100:00100000:2.0:1784938149.172293:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144142208:12345-0@lo:503: Request processed in 108us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.172300:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784938149.172340:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144142208:0@lo:503: 00000100:00100000:2.0:1784938149.175897:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8438:x1871643144141056:12345-192.168.203.126@tcp:700: Request processed in 44989us (46998us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.175915:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:0.0:1784938149.178162:0:9812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9812:1871643144142336:0@lo:502: 00000100:00100000:0.0:1784938149.178282:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938149.178325:0:9812:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.178356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144142336 00000100:00100000:2.0:1784938149.178372:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144142336 00000100:00100000:2.0:1784938149.178448:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784938149.178458:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:9812:x1871643144142336:12345-0@lo:502: 00000100:00100000:2.0:1784938149.178724:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:9812:x1871643144142336:12345-0@lo:502: Request processed in 268us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.178739:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:1.0:1784938149.179818:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4bb480 x1871643144141056/t0(0) o700->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:32/10 lens 264/248 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938149.179835:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8438:1871643144141056:192.168.203.126@tcp:700: 40000000:02000000:1.0:1784938149.179848:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1784938149.181135:0:9812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9812:1871643144142336:0@lo:502: 00000020:01000000:0.0:1784938149.181179:0:9812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784938149.181187:0:9812:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784938149.181196:0:9812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938149.181199:0:9812:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784938149.181206:0:9812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938149.181210:0:9812:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1784938149.181251:0:9812:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784938149.181255:0:9812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938149.181271:0:9812:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff910cfd763380) 00000020:00000080:0.0:1784938149.181297:0:9812:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1784938149.181302:0:9812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938149.181394:0:9812:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784938149.181399:0:9812:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784938149.181406:0:9812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ee22e 00010000:00080000:0.0:1784938149.181572:0:9812:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc73d5000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1784938149.181806:0:9812:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1784938149.182245:0:9812:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1784938149.182259:0:9812:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784938149.182416:0:9812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938149.184340:0:9812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938149.186637:0:9812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1784938149.186791:0:9812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1784938149.189590:0:9813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938149.189600:0:9813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784938149.196249:0:9812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938149.196268:0:9812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784938149.196332:0:9812:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784938149.196365:0:9812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ee235 00000100:00080000:3.0:1784938149.196380:0:9812:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:3.0:1784938149.196395:0:9812:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910bc73d5000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938149.196439:0:9812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc77c4e00 x1871643144142464/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938149.196462:0:9812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784938149.196523:0:9812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938149.196527:0:9812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938149.196529:0:9812:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784938149.196531:0:9812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938149.196535:0:9812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938149.196537:0:9812:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784938149.196539:0:9812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784938149.196542:0:9812:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784938149.196573:0:9812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9812:1871643144142592:0@lo:502: 00000100:00100000:3.0:1784938149.196670:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938149.196707:0:9812:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.196848:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144142464:192.168.203.126@tcp:8: 00000100:00100000:2.0:1784938149.196933:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144142592 00000100:00100000:2.0:1784938149.196939:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144142592 00000100:00100000:2.0:1784938149.196982:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784938149.196991:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:9812:x1871643144142592:12345-0@lo:502: 00000100:00100000:2.0:1784938149.197134:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:9812:x1871643144142592:12345-0@lo:502: Request processed in 144us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.197142:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784938149.197593:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.197630:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144142464 00000100:00100000:3.0:1784938149.197635:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144142464 00000100:00100000:3.0:1784938149.197663:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:3.0:1784938149.197668:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1871643144142464:12345-192.168.203.126@tcp:8: 00010000:00080000:3.0:1784938149.197697:0:8430:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:3.0:1784938149.197728:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ee23c 00002000:00100000:3.0:1784938149.197742:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff910bc70ff000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1784938149.197746:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1784938149.197749:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784938149.197850:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784938149.197882:0:8430:0:(import.c:65:import_set_state_nolock()) ffff910bc70fd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938149.197928:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1871643144142464:12345-192.168.203.126@tcp:8: Request processed in 259us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.197934:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:3.0:1784938149.198056:0:9812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:9812:1871643144142592:0@lo:502: 00010000:00080000:2.0:1784938149.198321:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c4e00 x1871643144142464/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938149.198333:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938149.198343:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784938149.198352:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784938149.198357:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784938149.198360:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc73d5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784938149.198375:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784938149.198382:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144142464:192.168.203.126@tcp:8: 00000020:01000000:3.0:1784938149.198842:0:9812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938149.198852:0:9812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938149.198855:0:9812:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784938149.198862:0:9812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:3.0:1784938149.199117:0:9813:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:2.0:1784938149.204637:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1784938149.204707:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784938149.204723:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.204739:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938149.204768:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784938149.204771:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff910cf3bf8000 from 1 10000000:01000000:2.0:1784938149.204774:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784938149.204844:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.204854:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.204867:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938149.204896:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144142720:0@lo:101: 00000100:00100000:2.0:1784938149.205001:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.205091:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.205093:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144142720 00000100:00100000:1.0:1784938149.205108:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144142720 00000100:00100000:1.0:1784938149.205186:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784938149.205195:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144142720:12345-0@lo:101: 00010000:00010000:1.0:1784938149.205247:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938149.205267:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee243 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.205296:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee243 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.205308:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee243 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938149.205316:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1200, rc 0) 00000100:00100000:1.0:1784938149.205396:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144142720:12345-0@lo:101: Request processed in 202us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.205403:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784938149.205480:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144142720:0@lo:101: 00010000:00010000:2.0:1784938149.205502:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.205514:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938149.205592:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144142848:0@lo:501: 00000100:00100000:2.0:1784938149.205641:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938149.205667:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.205686:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144142848 00000100:00100000:2.0:1784938149.205692:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144142848 00000100:00100000:2.0:1784938149.205730:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784938149.205747:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144142848:12345-0@lo:501: 00000100:00100000:2.0:1784938149.205849:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144142848:12345-0@lo:501: Request processed in 98us (202us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938149.205858:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784938149.206935:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144142848:0@lo:501: 10000000:01000000:2.0:1784938149.206993:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784938149.207003:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938149.207013:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938149.208952:0:9813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 217240732835ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784938149.208971:0:9813:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:1.0:1784938149.209917:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784938149.209934:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1784938149.210073:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9810:x1871643144140928:12345-192.168.203.126@tcp:700: Request processed in 81965us (84804us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.210086:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00000004:00080000:2.0:1784938149.210111:0:9814:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784938149.210155:0:9814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9814:1871643144143104:192.168.203.126@tcp:7: 00000100:00100000:2.0:1784938149.210303:0:9814:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.210384:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144142976:192.168.203.126@tcp:13: 00010000:00080000:1.0:1784938149.210415:0:9810:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587dc00 x1871643144140928/t0(0) o700->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:31/4 lens 264/248 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938149.210633:0:9810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9810:1871643144140928:192.168.203.126@tcp:700: 00000100:00100000:2.0:1784938149.210899:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938149.210942:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938149.210976:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144143104 00000100:00100000:2.0:1784938149.210985:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144143104 00000100:00100000:2.0:1784938149.211054:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:2.0:1784938149.211066:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9814:x1871643144143104:12345-192.168.203.126@tcp:7: 00000100:00100000:2.0:1784938149.211599:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144142976 00000100:00100000:2.0:1784938149.211605:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144142976 00000100:00100000:2.0:1784938149.211659:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:2.0:1784938149.211669:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144142976:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938149.211724:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:2.0:1784938149.211799:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144142976:12345-192.168.203.126@tcp:13: Request processed in 130us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.211807:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00080000:2.0:1784938149.211838:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1784938149.211872:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:3.0:1784938149.212515:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587ce00 x1871643144142976/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.212543:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144142976:192.168.203.126@tcp:13: 00002000:00080000:2.0:1784938149.215708:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1784938149.215721:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784938149.215837:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9814:x1871643144143104:12345-192.168.203.126@tcp:7: Request processed in 4765us (4932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.215850:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00010000:00080000:3.0:1784938149.218506:0:9814:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb16a00 x1871643144143104/t0(0) o7->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.218529:0:9814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9814:1871643144143104:192.168.203.126@tcp:7: 00000004:00080000:3.0:1784938149.218548:0:9814:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784938149.218677:0:9814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7769880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9814:1871643144143232:192.168.203.126@tcp:5: 00000100:00100000:2.0:1784938149.218785:0:9814:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.219539:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.219582:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144143232 00000100:00100000:3.0:1784938149.219590:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144143232 00000100:00100000:3.0:1784938149.219724:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:3.0:1784938149.219735:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9814:x1871643144143232:12345-192.168.203.126@tcp:5: 00002000:00080000:3.0:1784938149.219771:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784938149.219776:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1784938149.221049:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9814:x1871643144143232:12345-192.168.203.126@tcp:5: Request processed in 1308us (1505us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784938149.221061:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 11 00010000:00080000:2.0:1784938149.221887:0:9814:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7769880 x1871643144143232/t0(0) o5->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938149.221911:0:9814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7769880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9814:1871643144143232:192.168.203.126@tcp:5: 00000004:00080000:2.0:1784938149.221930:0:9814:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784938149.221979:0:9814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc776aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9814:1871643144143360:192.168.203.126@tcp:700: 00000100:00100000:2.0:1784938149.222042:0:9814:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.222172:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.222231:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144143360 00000100:00100000:3.0:1784938149.222238:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144143360 00000100:00100000:3.0:1784938149.222286:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938149.222296:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9814:x1871643144143360:12345-192.168.203.126@tcp:700: 00000100:00100000:3.0:1784938149.242188:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144143488:192.168.203.126@tcp:13: 00000100:00100000:3.0:1784938149.242682:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000004:00080000:2.0:1784938149.242779:0:9810:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784938149.242812:0:9810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9810:1871643144143616:192.168.203.126@tcp:7: 00000100:00100000:2.0:1784938149.242933:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938149.242959:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144143616 00000100:00100000:2.0:1784938149.242966:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144143616 00000100:00100000:2.0:1784938149.243035:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:2.0:1784938149.243043:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9810:x1871643144143616:12345-192.168.203.126@tcp:7: 00000100:00100000:3.0:1784938149.246426:0:9810:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938149.253697:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144143488 00000100:00100000:1.0:1784938149.253715:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144143488 00000100:00100000:1.0:1784938149.253775:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:1.0:1784938149.253785:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1871643144143488:12345-192.168.203.126@tcp:13: 00002000:00000024:1.0:1784938149.253812:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:1.0:1784938149.253905:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1871643144143488:12345-192.168.203.126@tcp:13: Request processed in 121us (11224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938149.253913:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 11 00010000:00080000:2.0:1784938149.254320:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c4380 x1871643144143488/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938149.254340:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144143488:192.168.203.126@tcp:13: 00000001:00080000:0.0:1784938149.255396:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1784938149.255557:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9814:x1871643144143360:12345-192.168.203.126@tcp:700: Request processed in 33255us (33386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938149.255588:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00010000:00080000:3.0:1784938149.264334:0:9814:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc776aa00 x1871643144143360/t0(0) o700->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:31/4 lens 264/248 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.264350:0:9814:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784938149.264369:0:9814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc776aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9814:1871643144143360:192.168.203.126@tcp:700: 00002000:00080000:2.0:1784938149.265338:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1784938149.265346:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784938149.265424:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9810:x1871643144143616:12345-192.168.203.126@tcp:7: Request processed in 22379us (22488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938149.265435:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 12 00010000:00080000:2.0:1784938149.265945:0:9810:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7768380 x1871643144143616/t0(0) o7->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938149.265959:0:9810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9810:1871643144143616:192.168.203.126@tcp:7: 00000004:00080000:2.0:1784938149.265972:0:9810:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784938149.266002:0:9810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9810:1871643144143744:192.168.203.126@tcp:5: 00000100:00100000:2.0:1784938149.272197:0:9810:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9472b40 going to sleep for 11 seconds 00000004:02000040:3.0:1784938149.276839:0:9814:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1784938149.283745:0:9814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9814:1871643144143872:192.168.203.126@tcp:5: 00000100:00100000:3.0:1784938149.283817:0:9814:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938149.286716:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938149.286756:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.289854:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144143744 00000100:00100000:3.0:1784938149.289878:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144143744 00000100:00100000:3.0:1784938149.289962:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144143872 00000100:00100000:3.0:1784938149.289966:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144143872 00000100:00100000:3.0:1784938149.289996:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:3.0:1784938149.290005:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9810:x1871643144143744:12345-192.168.203.126@tcp:5: 00002000:00080000:3.0:1784938149.290041:0:8770:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1784938149.290114:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9810:x1871643144143744:12345-192.168.203.126@tcp:5: Request processed in 110us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938149.290135:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:3.0:1784938149.290155:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:3.0:1784938149.290161:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9814:x1871643144143872:12345-192.168.203.126@tcp:5: 00010000:00080000:2.0:1784938149.295804:0:9810:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7768380 x1871643144143744/t0(0) o5->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938149.295831:0:9810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9810:1871643144143744:192.168.203.126@tcp:5: 00000004:00080000:2.0:1784938149.295851:0:9810:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784938149.295914:0:9810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9810:1871643144144000:192.168.203.126@tcp:5: 00000100:00100000:2.0:1784938149.296026:0:9810:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9472b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.310456:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938149.310493:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144144000 00000100:00100000:3.0:1784938149.310503:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144144000 00000100:00100000:3.0:1784938149.310554:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:3.0:1784938149.310568:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9810:x1871643144144000:12345-192.168.203.126@tcp:5: 00002000:00080000:3.0:1784938149.310623:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00002000:00080000:2.0:1784938149.315469:0:8770:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1784938149.315498:0:8770:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1784938149.326273:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9814:x1871643144143872:12345-192.168.203.126@tcp:5: Request processed in 36093us (39498us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784938149.326291:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:3.0:1784938149.333382:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9810:x1871643144144000:12345-192.168.203.126@tcp:5: Request processed in 22806us (22922us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784938149.333397:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00010000:00080000:3.0:1784938149.334108:0:9814:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c5500 x1871643144143872/t0(0) o5->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938149.334275:0:9814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9814:1871643144143872:192.168.203.126@tcp:5: 00000004:00080000:3.0:1784938149.334293:0:9814:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00080000:2.0:1784938149.343036:0:9810:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7768380 x1871643144144000/t0(0) o5->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938149.343066:0:9810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9810:1871643144144000:192.168.203.126@tcp:5: 00000004:00080000:2.0:1784938149.343087:0:9810:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784938149.343156:0:9810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc776a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9810:1871643144144128:192.168.203.126@tcp:900: 00000100:00100000:2.0:1784938149.343711:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938149.343855:0:9810:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf863e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938149.345258:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144144128 00000100:00100000:3.0:1784938149.345273:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144144128 00000100:00100000:3.0:1784938149.346292:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938149.346314:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9810:x1871643144144128:12345-192.168.203.126@tcp:900: 00000100:00100000:3.0:1784938149.346416:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9810:x1871643144144128:12345-192.168.203.126@tcp:900: Request processed in 110us (2706us total) trans 0 rc 0/0 00010000:00080000:2.0:1784938149.350242:0:9810:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc776a680 x1871643144144128/t0(0) o900->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:29/10 lens 264/248 e 0 to 0 dl 1784938165 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938149.350275:0:9810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc776a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9810:1871643144144128:192.168.203.126@tcp:900: 00000100:00100000:3.0:1784938149.352782:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00010000:00010000:3.0:1784938149.472560:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938150.502574:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938150.561451:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938150.561492:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144144256:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938150.561983:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938150.562023:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144144256 00000100:00100000:2.0:1784938150.562033:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144144256 00000100:00100000:2.0:1784938150.562095:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:2.0:1784938150.562107:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144144256:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938150.562147:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938150.562210:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144144256:12345-192.168.203.126@tcp:13: Request processed in 105us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938150.562255:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 12 00010000:00080000:2.0:1784938150.562379:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc776a680 x1871643144144256/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938150.562403:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144144256:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938150.562717:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938150.565588:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144144384:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938150.576957:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938150.577011:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144144384 00000100:00100000:2.0:1784938150.577023:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144144384 00000100:00100000:2.0:1784938150.577083:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:2.0:1784938150.577095:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144144384:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938150.577129:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938150.577199:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144144384:12345-192.168.203.126@tcp:13: Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938150.577207:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 13 00010000:00080000:2.0:1784938150.577751:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc776a680 x1871643144144384/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938150.577776:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144144384:192.168.203.126@tcp:13: 00000001:02000400:0.0:1784938150.624187:0:9881:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784938151.523313:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938151.588987:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144144512:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938151.591495:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938151.592686:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144144512 00000100:00100000:2.0:1784938151.592705:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144144512 00000100:00100000:2.0:1784938151.592885:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:2.0:1784938151.592909:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144144512:12345-192.168.203.126@tcp:41: 00000004:00000024:2.0:1784938151.592959:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1784938151.593059:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144144512:12345-192.168.203.126@tcp:41: Request processed in 162us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938151.593076:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:0.0:1784938151.593433:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144144512:192.168.203.126@tcp:41: 00000020:00000004:2.0:1784938151.903006:0:9933:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938151.903297:0:9933:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784938152.546233:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938153.119560:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938153.119603:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144144640:192.168.203.126@tcp:41: 00000100:00100000:0.0:1784938153.121429:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938153.121540:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144144640 00000100:00100000:2.0:1784938153.121549:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144144640 00000100:00100000:2.0:1784938153.121648:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:2.0:1784938153.121659:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144144640:12345-192.168.203.126@tcp:41: 00000004:00000024:2.0:1784938153.121698:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784938153.121803:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144144640:12345-192.168.203.126@tcp:41: Request processed in 145us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938153.121813:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:3.0:1784938153.122183:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144144640:192.168.203.126@tcp:41: 00000001:00080000:0.0:1784938153.172986:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1784938153.173006:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1784938153.567506:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938154.592439:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938154.655494:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144145024:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.655665:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144145536:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.655706:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144146048:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.655750:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784938154.655757:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144145152:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.655804:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144145664:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.655837:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144146176:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.655992:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144144768:0@lo:400: 00000100:00100000:0.0:1784938154.656201:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938154.656254:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938154.656279:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938154.656297:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938154.656327:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144145536 00000100:00100000:1.0:1784938154.656336:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144145536 00000100:00100000:0.0:1784938154.656372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938154.656400:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144145152 00000100:00100000:1.0:1784938154.656403:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144145152 00000100:00100000:0.0:1784938154.656406:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144146048 00000100:00100000:0.0:1784938154.656415:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144146048 00000100:00100000:1.0:1784938154.656423:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:1.0:1784938154.656432:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144145536:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.656436:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:0.0:1784938154.656440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144145152:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.657769:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144145152:12345-192.168.203.126@tcp:400: Request processed in 1315us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938154.657785:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:0.0:1784938154.657829:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:0.0:1784938154.657842:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144146048:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938154.658900:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938154.658927:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144146560:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938154.659276:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144145536:12345-192.168.203.126@tcp:400: Request processed in 2839us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938154.659289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:0.0:1784938154.659353:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144146048:12345-192.168.203.126@tcp:400: Request processed in 1512us (3052us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938154.659362:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:0.0:1784938154.659405:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144145664 00000100:00100000:0.0:1784938154.659415:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144145664 00000100:00100000:0.0:1784938154.659475:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:0.0:1784938154.659486:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144145664:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.659531:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144145664:12345-192.168.203.126@tcp:400: Request processed in 48us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938154.659538:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:0.0:1784938154.659629:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938154.659653:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144146176 00000100:00100000:1.0:1784938154.659659:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144146176 00000100:00100000:1.0:1784938154.659830:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:1.0:1784938154.659836:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144146176:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938154.659861:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144146176:12345-192.168.203.126@tcp:400: Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938154.659882:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 11 00010000:00080000:0.0:1784938154.659886:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4835880 x1871643144145152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938154.659907:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144145152:192.168.203.126@tcp:400: 00010000:00080000:0.0:1784938154.659927:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7dce00 x1871643144145664/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938154.659937:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144145664:192.168.203.126@tcp:400: 00010000:00080000:0.0:1784938154.659963:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7dd500 x1871643144145536/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938154.659973:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144145536:192.168.203.126@tcp:400: 00010000:00080000:0.0:1784938154.659987:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7dca80 x1871643144146048/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938154.659998:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144146048:192.168.203.126@tcp:400: 00010000:00080000:0.0:1784938154.660090:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7dfb80 x1871643144146176/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938154.660099:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1784938154.660112:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144146176:192.168.203.126@tcp:400: 00000100:00080000:0.0:1784938154.660146:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938154.660151:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938154.660154:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938154.660168:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144145024 00000100:00100000:0.0:1784938154.660173:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144145024 00000100:00100000:0.0:1784938154.660254:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00100000:0.0:1784938154.660262:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144145024:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.660302:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144145024:12345-192.168.203.126@tcp:400: Request processed in 41us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938154.660310:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00100000:0.0:1784938154.660405:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144145024:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.660458:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144144896:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.660510:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144145408:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.660547:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144145920:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.660799:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144146432:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938154.660970:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938154.661018:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144145280:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.661051:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144145792:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.661073:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144146304:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.661240:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938154.661322:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938154.661344:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938154.661367:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938154.661390:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938154.661414:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938154.661436:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938154.661458:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144146304 00000100:00100000:2.0:1784938154.661475:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144146304 00000100:00100000:2.0:1784938154.661521:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144145792 00000100:00100000:2.0:1784938154.661525:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144145792 00000100:00100000:2.0:1784938154.661548:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:2.0:1784938154.661558:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144146304:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.661852:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144146304:12345-192.168.203.126@tcp:400: Request processed in 294us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938154.661862:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:2.0:1784938154.661882:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:2.0:1784938154.661888:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144145792:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.661914:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144145792:12345-192.168.203.126@tcp:400: Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938154.661919:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:2.0:1784938154.661941:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144146432 00000100:00100000:2.0:1784938154.661945:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144146432 00000100:00100000:2.0:1784938154.661970:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:2.0:1784938154.661977:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144146432:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938154.662004:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938154.662034:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144146432:12345-192.168.203.126@tcp:13: Request processed in 57us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938154.662040:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:2.0:1784938154.662061:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144145280 00000100:00100000:2.0:1784938154.662065:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144145280 00000100:00100000:2.0:1784938154.662093:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:2.0:1784938154.662100:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144145280:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.662128:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144145280:12345-192.168.203.126@tcp:400: Request processed in 29us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938154.662143:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00080000:2.0:1784938154.662161:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938154.662165:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938154.662195:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144144896 00000100:00100000:2.0:1784938154.662199:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144144896 00000100:00100000:2.0:1784938154.662402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144145408 00000100:00100000:2.0:1784938154.662407:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144145408 00000100:00100000:2.0:1784938154.662427:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144145920 00000100:00100000:2.0:1784938154.662430:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144145920 00000100:00100000:2.0:1784938154.662444:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:2.0:1784938154.662449:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144144896:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.662478:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144144896:12345-192.168.203.126@tcp:400: Request processed in 28us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938154.662485:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:2.0:1784938154.662497:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:2.0:1784938154.662504:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144145408:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.662530:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144145408:12345-192.168.203.126@tcp:400: Request processed in 26us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938154.662536:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:2.0:1784938154.662546:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:2.0:1784938154.662552:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144145920:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.662792:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144145920:12345-192.168.203.126@tcp:400: Request processed in 22us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938154.662801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00080000:2.0:1784938154.662825:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784938154.663085:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4835180 x1871643144144896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938154.663112:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144144896:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938154.663130:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7dc380 x1871643144145408/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938154.663140:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144145408:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938154.663151:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7de680 x1871643144145920/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938154.663161:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144145920:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938154.663173:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c4e00 x1871643144146432/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938154.663180:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784938154.663238:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144146432:192.168.203.126@tcp:13: 00010000:00080000:2.0:1784938154.663289:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7df480 x1871643144146304/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938154.663298:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144146304:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938154.663314:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144145280:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938154.663324:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7ddf80 x1871643144145792/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938154.663334:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144145792:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938154.663783:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144144768 00000100:00100000:0.0:1784938154.663791:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144144768 00000100:00100000:0.0:1784938154.663845:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784938154.663854:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144144768:12345-0@lo:400: 00000100:00100000:0.0:1784938154.663920:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144144768:12345-0@lo:400: Request processed in 67us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938154.663927:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784938154.663967:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144144768:0@lo:400: 00000100:00100000:0.0:1784938154.666079:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938154.666196:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144146560 00000100:00100000:2.0:1784938154.666206:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144146560 00000100:00100000:2.0:1784938154.666316:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:2.0:1784938154.666327:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144146560:12345-192.168.203.126@tcp:13: 00002000:00000024:2.0:1784938154.666358:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938154.666901:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144146560:12345-192.168.203.126@tcp:13: Request processed in 572us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938154.666911:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00010000:00080000:3.0:1784938154.667267:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c7b80 x1871643144146560/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938154.667292:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144146560:192.168.203.126@tcp:13: 00000020:00000004:3.0:1784938155.193209:0:10034:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938155.193844:0:10034:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784938155.615368:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938155.679729:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938155.679765:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144146688:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938155.680113:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938155.680150:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144146688 00000100:00100000:1.0:1784938155.680159:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144146688 00000100:00100000:1.0:1784938155.680245:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:1.0:1784938155.680256:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144146688:12345-192.168.203.126@tcp:13: 00002000:00000024:1.0:1784938155.680297:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938155.680344:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144146688:12345-192.168.203.126@tcp:13: Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938155.680352:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 16 00010000:00080000:1.0:1784938155.680503:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4bbb80 x1871643144146688/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938155.680527:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144146688:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938155.681146:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144146816:192.168.203.126@tcp:13: 00000100:00100000:3.0:1784938155.681396:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938155.681419:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144146816 00000100:00100000:3.0:1784938155.681424:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144146816 00000100:00100000:3.0:1784938155.681459:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:3.0:1784938155.681467:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144146816:12345-192.168.203.126@tcp:13: 00002000:00000024:3.0:1784938155.681485:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938155.681517:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144146816:12345-192.168.203.126@tcp:13: Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938155.681525:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 17 00010000:00080000:3.0:1784938155.681932:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c7b80 x1871643144146816/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938155.681952:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144146816:192.168.203.126@tcp:13: 00000020:00000004:1.0:1784938156.096858:0:10082:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938156.096875:0:10082:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1784938156.600947:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938156.601191:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125219456 00000100:00100000:2.0:1784938156.601206:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125219456 00000100:00100000:2.0:1784938156.601284:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:2.0:1784938156.601294:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2391:x1871643125219456:12345-192.168.203.26@tcp:250: 00010000:00080000:2.0:1784938156.601333:0:6507:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from db2a3c47-6f11-4ea2-835e-381143ebe8d4@192.168.203.26@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1784938156.601370:0:6507:0:(genops.c:1406:class_connect()) connect: client db2a3c47-6f11-4ea2-835e-381143ebe8d4, cookie 0x26783cd1c59ee251 00000100:00080000:2.0:1784938156.601539:0:6507:0:(import.c:65:import_set_state_nolock()) ffff910bc5b2f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938156.601655:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+5:2391:x1871643125219456:12345-192.168.203.26@tcp:250: Request processed in 360us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938156.601664:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:2.0:1784938156.613541:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938156.613809:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125219584 00000100:00100000:1.0:1784938156.613823:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125219584 00000100:00100000:1.0:1784938156.613901:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:1.0:1784938156.613913:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+5:6152:x1871643125219584:12345-192.168.203.26@tcp:101: 00010000:00010000:1.0:1784938156.613935:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938156.613959:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a284f0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938156.613997:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f0 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938156.614027:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f0 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938156.614038:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0e00, rc 0) 00000100:00100000:1.0:1784938156.614122:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+6:6152:x1871643125219584:12345-192.168.203.26@tcp:101: Request processed in 210us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938156.614130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:3.0:1784938156.615988:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938156.616131:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125219712 00000100:00100000:2.0:1784938156.616144:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125219712 00000100:00100000:2.0:1784938156.616246:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:2.0:1784938156.616258:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+6:6152:x1871643125219712:12345-192.168.203.26@tcp:501: 00000100:00100000:2.0:1784938156.616508:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+6:6152:x1871643125219712:12345-192.168.203.26@tcp:501: Request processed in 252us (531us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938156.616517:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:3.0:1784938156.623432:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938156.623517:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125219840 00000100:00100000:1.0:1784938156.623531:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125219840 00000100:00100000:1.0:1784938156.623624:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:1.0:1784938156.623635:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+6:6152:x1871643125219840:12345-192.168.203.26@tcp:101: 00010000:00010000:1.0:1784938156.623658:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938156.623681:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a284f7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938156.623739:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f7 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938156.623753:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f7 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938156.623764:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1e00, rc 0) 00000100:00100000:1.0:1784938156.631407:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+7:6152:x1871643125219840:12345-192.168.203.26@tcp:101: Request processed in 7754us (7971us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938156.631424:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:3.0:1784938156.639318:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938156.640042:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125219968 00000100:00100000:1.0:1784938156.640057:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125219968 00000100:00100000:1.0:1784938156.640147:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:1.0:1784938156.640161:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+7:6152:x1871643125219968:12345-192.168.203.26@tcp:501: 00000100:00100000:1.0:1784938156.640398:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:6152:x1871643125219968:12345-192.168.203.26@tcp:501: Request processed in 241us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938156.640408:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:1.0:1784938156.643462:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938156.643782:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125220096 00000100:00100000:2.0:1784938156.643798:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125220096 00000100:00100000:2.0:1784938156.643889:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:2.0:1784938156.643902:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:6152:x1871643125220096:12345-192.168.203.26@tcp:503: 00000100:00100000:2.0:1784938156.644159:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:6152:x1871643125220096:12345-192.168.203.26@tcp:503: Request processed in 257us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938156.644170:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 188 00010000:00010000:0.0:1784938156.648436:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938156.648654:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938156.649329:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125220224 00000100:00100000:3.0:1784938156.649342:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125220224 00000100:00100000:3.0:1784938156.649460:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:3.0:1784938156.649473:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:6171:x1871643125220224:12345-192.168.203.26@tcp:502: 00000100:00100000:3.0:1784938156.649910:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:6171:x1871643125220224:12345-192.168.203.26@tcp:502: Request processed in 439us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938156.649920:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:2.0:1784938156.683519:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938156.683601:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125220352 00000100:00100000:1.0:1784938156.683615:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125220352 00000100:00100000:1.0:1784938156.683733:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:1.0:1784938156.683746:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:6171:x1871643125220352:12345-192.168.203.26@tcp:502: 00000100:00100000:1.0:1784938156.683980:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:6171:x1871643125220352:12345-192.168.203.26@tcp:502: Request processed in 236us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938156.683990:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:0.0:1784938156.689858:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938156.690367:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125220480 00000100:00100000:3.0:1784938156.690381:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125220480 00000100:00100000:2.0:1784938156.690636:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:2.0:1784938156.690650:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:6152:x1871643125220480:12345-192.168.203.26@tcp:101: 00010000:00010000:2.0:1784938156.690673:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938156.690697:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7469600/0x26783cd1c59ee266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28528 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938156.690733:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7469600/0x26783cd1c59ee266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28528 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938156.690747:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7469600/0x26783cd1c59ee266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28528 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938156.690758:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7469600, rc 0) 00000100:00100000:2.0:1784938156.690838:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6152:x1871643125220480:12345-192.168.203.26@tcp:101: Request processed in 192us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938156.690849:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:3.0:1784938156.693122:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938156.696256:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125220608 00000100:00100000:1.0:1784938156.696281:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125220608 00000100:00100000:1.0:1784938156.696378:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:1.0:1784938156.696393:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6152:x1871643125220608:12345-192.168.203.26@tcp:256: 20000000:01000000:1.0:1784938156.696491:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784938156.696533:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784938156.696538:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784938156.696541:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784938156.696545:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1784938156.697466:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1784938156.701920:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6152:x1871643125220608:12345-192.168.203.26@tcp:256: Request processed in 5514us (8795us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938156.701940:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:3.0:1784938156.703490:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938156.703526:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144146944:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938156.704127:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938156.704338:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144146944 00000100:00100000:3.0:1784938156.704349:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144146944 00000100:00100000:3.0:1784938156.704416:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 59 00000100:00100000:3.0:1784938156.704427:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144146944:12345-192.168.203.126@tcp:41: 00000004:00000024:3.0:1784938156.704475:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784938156.704701:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144146944:12345-192.168.203.126@tcp:41: Request processed in 274us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938156.704709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 59 00000100:00100000:1.0:1784938156.716100:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144146944:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938156.724226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938156.725085:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125220736 00000100:00100000:0.0:1784938156.725100:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125220736 00000100:00100000:0.0:1784938156.725183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:0.0:1784938156.725195:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6152:x1871643125220736:12345-192.168.203.26@tcp:101: 00010000:00010000:0.0:1784938156.725259:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938156.725282:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2852f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938156.725319:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2852f expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938156.725332:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2852f expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938156.725356:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76600, rc 0) 00000100:00100000:0.0:1784938156.725436:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6152:x1871643125220736:12345-192.168.203.26@tcp:101: Request processed in 244us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938156.725443:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:3.0:1784938156.727867:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938156.728151:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125220864 00000100:00100000:1.0:1784938156.728166:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125220864 00000100:00100000:1.0:1784938156.728288:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:1.0:1784938156.728300:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6152:x1871643125220864:12345-192.168.203.26@tcp:501: 00000100:00100000:1.0:1784938156.728505:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6152:x1871643125220864:12345-192.168.203.26@tcp:501: Request processed in 207us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938156.728514:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:1.0:1784938156.736340:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938156.736859:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125220992 00000100:00100000:2.0:1784938156.736875:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125220992 00000100:00100000:2.0:1784938156.736949:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:2.0:1784938156.736961:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6152:x1871643125220992:12345-192.168.203.26@tcp:503: 00000100:00100000:2.0:1784938156.737157:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6152:x1871643125220992:12345-192.168.203.26@tcp:503: Request processed in 197us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938156.737165:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:2.0:1784938156.740180:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938156.743433:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125221120 00000100:00100000:0.0:1784938156.743457:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125221120 00000100:00100000:0.0:1784938156.743693:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:0.0:1784938156.743708:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6176:x1871643125221120:12345-192.168.203.26@tcp:502: 00000100:00100000:0.0:1784938156.743940:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6176:x1871643125221120:12345-192.168.203.26@tcp:502: Request processed in 235us (3774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938156.743949:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:3.0:1784938156.746773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938156.747210:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125221248 00000100:00100000:1.0:1784938156.747268:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125221248 00000100:00100000:1.0:1784938156.747340:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:1.0:1784938156.747351:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6176:x1871643125221248:12345-192.168.203.26@tcp:502: 00000100:00100000:1.0:1784938156.747591:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6176:x1871643125221248:12345-192.168.203.26@tcp:502: Request processed in 241us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938156.747601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:1.0:1784938156.755595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938156.755647:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938156.755757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125221376 00000100:00100000:2.0:1784938156.755769:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125221376 00000100:00100000:2.0:1784938156.755819:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125221632 00000100:00100000:2.0:1784938156.755822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125221632 00000100:00100000:2.0:1784938156.755853:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1784938156.755863:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1871643125221376:12345-192.168.203.26@tcp:38: 00010000:00080000:2.0:1784938156.755901:0:6513:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from 263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1784938156.755976:0:6513:0:(genops.c:1406:class_connect()) connect: client 263deb07-6496-49f7-9596-7a44f1bd8c2b, cookie 0x26783cd1c59ee274 00000100:00100000:3.0:1784938156.755986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:3.0:1784938156.755995:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1871643125221632:12345-192.168.203.26@tcp:38: 00010000:00080000:3.0:1784938156.756016:0:6514:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from 263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp t0 exp 0000000000000000 cur 224 last 0 00000004:00100000:2.0:1784938156.756023:0:6513:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1784938156.756064:0:6514:0:(genops.c:1406:class_connect()) connect: client 263deb07-6496-49f7-9596-7a44f1bd8c2b, cookie 0x26783cd1c59ee27b 00000004:00100000:3.0:1784938156.756102:0:6514:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784938156.756452:0:6514:0:(import.c:65:import_set_state_nolock()) ffff910bc70fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938156.756557:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2391:x1871643125221632:12345-192.168.203.26@tcp:38: Request processed in 560us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938156.756579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00080000:2.0:1784938156.756635:0:6513:0:(import.c:65:import_set_state_nolock()) ffff910bc5b2d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938156.756666:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2391:x1871643125221376:12345-192.168.203.26@tcp:38: Request processed in 803us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938156.756673:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00010000:00010000:1.0:1784938157.663632:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938157.773095:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938157.773164:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938157.773286:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938157.773491:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125221888 00000100:00100000:0.0:1784938157.773501:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125221888 00000100:00100000:0.0:1784938157.773573:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125221760 00000100:00100000:0.0:1784938157.773576:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125221760 00000100:00100000:0.0:1784938157.773591:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125221504 00000100:00100000:0.0:1784938157.773593:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125221504 00000100:00100000:0.0:1784938157.773608:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:0.0:1784938157.773616:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:6152:x1871643125221888:12345-192.168.203.26@tcp:41: 00000004:00000024:0.0:1784938157.773652:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784938157.773712:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:6152:x1871643125221888:12345-192.168.203.26@tcp:41: Request processed in 96us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938157.773719:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:0.0:1784938157.773736:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1784938157.773742:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:0:x1871643125221760:12345-192.168.203.26@tcp:41: 00000004:00000024:0.0:1784938157.773766:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938157.773790:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:0:x1871643125221760:12345-192.168.203.26@tcp:41: Request processed in 48us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938157.773796:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1784938157.773807:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1784938157.773813:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:0:x1871643125221504:12345-192.168.203.26@tcp:41: 00000004:00000024:0.0:1784938157.773822:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784938157.773839:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:0:x1871643125221504:12345-192.168.203.26@tcp:41: Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938157.773845:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00080000:2.0:1784938157.773907:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938157.773911:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938157.775845:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938157.775926:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125222016 00000100:00100000:2.0:1784938157.775944:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125222016 00000100:00100000:2.0:1784938157.775996:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:2.0:1784938157.776006:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6152:x1871643125222016:12345-192.168.203.26@tcp:40: 00000100:00100000:2.0:1784938157.776081:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6152:x1871643125222016:12345-192.168.203.26@tcp:40: Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938157.776088:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1784938157.782480:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938157.782578:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938157.783144:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938157.783179:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938157.783211:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125222528 00000100:00100000:1.0:1784938157.783255:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125222528 00000100:00100000:1.0:1784938157.783305:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1784938157.783314:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6152:x1871643125222528:12345-192.168.203.26@tcp:900: 00000100:00100000:1.0:1784938157.783422:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6152:x1871643125222528:12345-192.168.203.26@tcp:900: Request processed in 109us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938157.783431:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:0.0:1784938157.783675:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125222400 00000100:00100000:0.0:1784938157.783688:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125222400 00000100:00100000:0.0:1784938157.783726:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:0.0:1784938157.783733:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125222400:12345-192.168.203.26@tcp:400: 00000100:00100000:0.0:1784938157.783765:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125222400:12345-192.168.203.26@tcp:400: Request processed in 33us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938157.783771:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:2.0:1784938157.787487:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125222144 00000100:00100000:2.0:1784938157.787502:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125222144 00000100:00100000:2.0:1784938157.787571:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125222272 00000100:00100000:2.0:1784938157.787576:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125222272 00000100:00100000:2.0:1784938157.787614:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1784938157.787623:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2391:x1871643125222144:12345-192.168.203.26@tcp:8: 00010000:00080000:2.0:1784938157.787667:0:8430:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp t0 exp 0000000000000000 cur 225 last 0 00000100:00100000:1.0:1784938157.787884:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1784938157.787890:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1871643125222272:12345-192.168.203.26@tcp:8: 00010000:00080000:1.0:1784938157.787907:0:8431:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:1.0:1784938157.787931:0:8431:0:(genops.c:1406:class_connect()) connect: client 263deb07-6496-49f7-9596-7a44f1bd8c2b, cookie 0x26783cd1c59ee282 00002000:00100000:1.0:1784938157.787941:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 263deb07-6496-49f7-9596-7a44f1bd8c2b/ffff910bc7c61000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938157.787957:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938157.788117:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784938157.788145:0:8431:0:(import.c:65:import_set_state_nolock()) ffff910bc7c63000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938157.788203:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2391:x1871643125222272:12345-192.168.203.26@tcp:8: Request processed in 311us (5625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938157.788210:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000020:00000080:2.0:1784938157.789025:0:8430:0:(genops.c:1406:class_connect()) connect: client 263deb07-6496-49f7-9596-7a44f1bd8c2b, cookie 0x26783cd1c59ee289 00002000:00100000:2.0:1784938157.789034:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 263deb07-6496-49f7-9596-7a44f1bd8c2b/ffff910bc58d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784938157.789050:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784938157.789270:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784938157.789289:0:8430:0:(import.c:65:import_set_state_nolock()) ffff910bc58d3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938157.789337:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2391:x1871643125222144:12345-192.168.203.26@tcp:8: Request processed in 1715us (6866us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938157.789641:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:0.0:1784938157.806549:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938157.806762:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125222656 00000100:00100000:3.0:1784938157.806771:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125222656 00000100:00100000:3.0:1784938157.806827:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:3.0:1784938157.806837:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6152:x1871643125222656:12345-192.168.203.26@tcp:33: 00000004:00080000:3.0:1784938157.850535:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43616us 00000004:00200000:0.0:1784938157.861755:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784938157.861883:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6152:x1871643125222656:12345-192.168.203.26@tcp:33: Request processed in 55042us (55337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938157.861897:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:1.0:1784938158.099078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938158.099180:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125222784 00000100:00100000:2.0:1784938158.099190:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125222784 00000100:00100000:2.0:1784938158.099285:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1784938158.099295:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6194:x1871643125222784:12345-192.168.203.26@tcp:101: 00010000:00010000:2.0:1784938158.099314:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938158.099426:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee290 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28560 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938158.099509:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee297 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938158.099523:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938158.099536:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938158.099595:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784938158.099599:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938158.099616:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938158.099641:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28560 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938158.099659:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee297 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28560 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938158.099667:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910ccee40b00) 00010000:00010000:2.0:1784938158.099670:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938158.099673:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7469e00, rc 0) 00000100:00100000:2.0:1784938158.099732:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:6194:x1871643125222784:12345-192.168.203.26@tcp:101: Request processed in 439us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938158.099739:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1784938158.239706:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938158.239733:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144147072:192.168.203.126@tcp:41: 00000100:00100000:0.0:1784938158.240277:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938158.240655:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144147072 00000100:00100000:3.0:1784938158.240664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144147072 00000100:00100000:3.0:1784938158.240732:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:3.0:1784938158.240742:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144147072:12345-192.168.203.126@tcp:41: 00000004:00000024:3.0:1784938158.240777:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784938158.240836:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144147072:12345-192.168.203.126@tcp:41: Request processed in 96us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938158.240844:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:2.0:1784938158.242078:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144147072:192.168.203.126@tcp:41: 00010000:00010000:3.0:1784938158.687579:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938159.711663:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938159.775996:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144147200:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938159.776126:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144147712:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938159.776159:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144148224:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938159.776184:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144148736:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938159.776211:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784938159.776248:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144147584:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938159.776893:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938159.776971:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938159.776991:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938159.777016:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938159.777041:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144148224 00000100:00100000:0.0:1784938159.777046:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144148224 00000100:00100000:0.0:1784938159.777098:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144148736 00000100:00100000:0.0:1784938159.777101:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144148736 00000100:00100000:0.0:1784938159.777122:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:0.0:1784938159.777131:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144148224:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938159.777188:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144148224:12345-192.168.203.126@tcp:400: Request processed in 57us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938159.777195:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144147328:0@lo:400: 00000100:00100000:0.0:1784938159.777199:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:0.0:1784938159.777249:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:1.0:1784938159.777267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938159.777298:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144147840:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.777326:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144148352:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.777347:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144148864:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.777376:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1784938159.777382:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144147456:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.777405:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144147968:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938159.777423:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144147200 00000100:00100000:3.0:1784938159.777429:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144147200 00000100:00100000:1.0:1784938159.777443:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144148480:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938159.777465:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:1.0:1784938159.777469:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144148992:192.168.203.126@tcp:13: 00000100:00100000:3.0:1784938159.777478:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1871643144147200:12345-192.168.203.126@tcp:13: 00002000:00000024:3.0:1784938159.777503:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938159.777513:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144147328 00000100:00100000:1.0:1784938159.777518:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144147328 00000100:00100000:3.0:1784938159.777531:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1871643144147200:12345-192.168.203.126@tcp:13: Request processed in 57us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938159.777560:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:1.0:1784938159.777564:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784938159.777574:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144147328:12345-0@lo:400: 00000100:00100000:1.0:1784938159.777622:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144147328:12345-0@lo:400: Request processed in 50us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938159.777633:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784938159.777691:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144147328:0@lo:400: 00000100:00080000:1.0:1784938159.777732:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938159.777736:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938159.777778:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938159.777789:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938159.777812:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938159.777825:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144148352 00000100:00100000:3.0:1784938159.777828:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144148352 00000100:00100000:3.0:1784938159.777857:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144148864 00000100:00100000:1.0:1784938159.777869:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938159.777871:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144148864 00000100:00100000:3.0:1784938159.777894:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:3.0:1784938159.777902:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144148352:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.777910:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938159.778135:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144148352:12345-192.168.203.126@tcp:400: Request processed in 233us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938159.778142:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:3.0:1784938159.778156:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:3.0:1784938159.778162:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144148864:12345-192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938159.779554:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144148736:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.785239:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144147712 00000100:00100000:1.0:1784938159.785252:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144147712 00000100:00100000:1.0:1784938159.785572:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144147968 00000100:00100000:1.0:1784938159.785577:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144147968 00000100:00100000:1.0:1784938159.785610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:1.0:1784938159.785618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144147712:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.785716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144147712:12345-192.168.203.126@tcp:400: Request processed in 98us (8723us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938159.785724:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:1.0:1784938159.785742:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 51 00000100:00100000:1.0:1784938159.785749:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144147968:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.785784:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144147968:12345-192.168.203.126@tcp:400: Request processed in 35us (7915us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938159.785790:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 51 00000100:00100000:1.0:1784938159.786140:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144147968:192.168.203.126@tcp:400: 00000100:00080000:1.0:1784938159.786190:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938159.786195:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938159.786198:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938159.786209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144147840 00000100:00100000:1.0:1784938159.786233:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144147840 00000100:00100000:1.0:1784938159.786262:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 61 00000100:00100000:1.0:1784938159.786268:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144147840:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.788147:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144147840:12345-192.168.203.126@tcp:400: Request processed in 1868us (10358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938159.788159:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 61 00000100:00100000:1.0:1784938159.788253:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938159.788552:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144148864:12345-192.168.203.126@tcp:400: Request processed in 10377us (10724us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938159.788563:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:3.0:1784938159.788594:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144148992 00000100:00100000:3.0:1784938159.788601:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144148992 00000100:00100000:3.0:1784938159.788638:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:3.0:1784938159.788645:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144148992:12345-192.168.203.126@tcp:13: 00002000:00000024:3.0:1784938159.788670:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938159.788728:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144148992:12345-192.168.203.126@tcp:13: Request processed in 82us (10818us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938159.788734:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:3.0:1784938159.788791:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938159.789440:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144148096:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938159.789481:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144148608:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938159.789519:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c7b80 x1871643144147200/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938159.789538:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144147200:192.168.203.126@tcp:13: 00000100:00100000:2.0:1784938159.789565:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144147712:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938159.789577:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb76d80 x1871643144148224/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938159.789586:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144148224:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938159.789630:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144147456 00000100:00100000:2.0:1784938159.789636:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144147456 00000100:00100000:1.0:1784938159.789714:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144148480 00000100:00100000:1.0:1784938159.789719:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144148480 00000100:00100000:1.0:1784938159.789757:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:1.0:1784938159.789765:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144148480:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.789820:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144148480:12345-192.168.203.126@tcp:400: Request processed in 54us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938159.789827:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00080000:1.0:1784938159.789851:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784938159.789884:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb75f80 x1871643144148992/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938159.789899:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144148992:192.168.203.126@tcp:13: 00010000:00080000:1.0:1784938159.789928:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb75880 x1871643144148352/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938159.789937:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144148352:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.789994:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144148480:192.168.203.126@tcp:400: 00000100:00100000:0.0:1784938159.790061:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144148736:12345-192.168.203.126@tcp:400: Request processed in 12800us (13039us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938159.790071:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:2.0:1784938159.791072:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:2.0:1784938159.791086:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144147456:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938159.791189:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938159.791234:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938159.791915:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938159.792047:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144147840:192.168.203.126@tcp:400: 00010000:00080000:1.0:1784938159.792064:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb74e00 x1871643144148864/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938159.792075:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144148864:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.792129:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144147584 00000100:00100000:1.0:1784938159.792135:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144147584 00000100:00100000:1.0:1784938159.792190:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:1.0:1784938159.792198:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144147584:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938159.792273:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144147584:12345-192.168.203.126@tcp:400: Request processed in 76us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938159.792281:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:2.0:1784938159.792381:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144147456:12345-192.168.203.126@tcp:400: Request processed in 1299us (4128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938159.792390:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:2.0:1784938159.798708:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144148096 00000100:00100000:2.0:1784938159.798722:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144148096 00000100:00100000:2.0:1784938159.798788:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144148608 00000100:00100000:2.0:1784938159.798791:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144148608 00000100:00100000:2.0:1784938159.798813:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:2.0:1784938159.798822:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144148096:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938159.798905:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144148096:12345-192.168.203.126@tcp:400: Request processed in 84us (7670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938159.798912:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:2.0:1784938159.798928:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:2.0:1784938159.798934:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144148608:12345-192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938159.798953:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144148608:12345-192.168.203.126@tcp:400: Request processed in 20us (7698us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938159.798958:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00080000:2.0:1784938159.798977:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938159.799164:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144147584:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938159.799179:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb77800 x1871643144148096/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938159.799189:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144148096:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938159.799199:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb74380 x1871643144148608/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938159.799242:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144148608:192.168.203.126@tcp:400: 00010000:00080000:2.0:1784938159.799390:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb75500 x1871643144148736/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938159.799402:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144148736:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938159.799472:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144147456:192.168.203.126@tcp:400: 00000100:00100000:2.0:1784938160.382454:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938160.382568:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125222912 00000100:00100000:0.0:1784938160.382578:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125222912 00000100:00100000:0.0:1784938160.382660:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:0.0:1784938160.382670:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:6246:x1871643125222912:12345-192.168.203.26@tcp:41: 00000004:00000024:0.0:1784938160.382711:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784938160.382782:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:6246:x1871643125222912:12345-192.168.203.26@tcp:41: Request processed in 114us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938160.382790:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00080000:2.0:1784938160.382854:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938160.384797:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938160.384883:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125223040 00000100:00100000:1.0:1784938160.384893:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125223040 00000100:00100000:1.0:1784938160.384957:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:1.0:1784938160.384968:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6246:x1871643125223040:12345-192.168.203.26@tcp:41: 00000004:00000024:1.0:1784938160.385003:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938160.385072:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6246:x1871643125223040:12345-192.168.203.26@tcp:41: Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938160.385080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00080000:2.0:1784938160.385313:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938160.396275:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938160.400459:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125223168 00000100:00100000:0.0:1784938160.400482:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125223168 00000100:00100000:0.0:1784938160.400582:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1784938160.400594:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6246:x1871643125223168:12345-192.168.203.26@tcp:13: 00002000:00000024:0.0:1784938160.400745:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938160.400900:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6246:x1871643125223168:12345-192.168.203.26@tcp:13: Request processed in 308us (4633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938160.400908:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00080000:2.0:1784938160.401007:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938160.406120:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938160.406919:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125223296 00000100:00100000:3.0:1784938160.406931:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125223296 00000100:00100000:3.0:1784938160.407011:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:3.0:1784938160.407021:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6246:x1871643125223296:12345-192.168.203.26@tcp:13: 00002000:00000024:3.0:1784938160.407048:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938160.407125:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:6246:x1871643125223296:12345-192.168.203.26@tcp:13: Request processed in 105us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938160.407133:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00080000:2.0:1784938160.409032:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784938160.737241:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938160.800155:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144149120:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938160.801133:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938160.801837:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144149120 00000100:00100000:3.0:1784938160.801850:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144149120 00000100:00100000:3.0:1784938160.801899:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:3.0:1784938160.801908:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144149120:12345-192.168.203.126@tcp:13: 00002000:00000024:3.0:1784938160.801941:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938160.801994:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144149120:12345-192.168.203.126@tcp:13: Request processed in 87us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938160.802002:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:2.0:1784938160.802297:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938160.802311:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144149248:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938160.803287:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938160.803461:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144149248 00000100:00100000:0.0:1784938160.803469:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144149248 00000100:00100000:0.0:1784938160.803514:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:0.0:1784938160.803523:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144149248:12345-192.168.203.126@tcp:13: 00002000:00000024:0.0:1784938160.803573:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938160.803642:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144149248:12345-192.168.203.126@tcp:13: Request processed in 120us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938160.803650:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 23 00010000:00080000:3.0:1784938160.803869:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd458000 x1871643144149248/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938160.803891:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144149248:192.168.203.126@tcp:13: 00010000:00080000:3.0:1784938160.803905:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587dc00 x1871643144149120/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938160.804064:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144149120:192.168.203.126@tcp:13: 00010000:00010000:0.0:1784938161.762857:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938161.825722:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144149376:192.168.203.126@tcp:41: 00000100:00100000:3.0:1784938161.826007:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938161.826038:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144149376 00000100:00100000:3.0:1784938161.826045:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144149376 00000100:00100000:3.0:1784938161.826089:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 63 00000100:00100000:3.0:1784938161.826097:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144149376:12345-192.168.203.126@tcp:41: 00000004:00000024:3.0:1784938161.826131:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784938161.826173:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144149376:12345-192.168.203.126@tcp:41: Request processed in 77us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938161.826181:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 63 00000100:00100000:3.0:1784938161.826343:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144149376:192.168.203.126@tcp:41: 00000001:00100000:3.0:1784938161.833909:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00010000:00010000:3.0:1784938162.790731:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938162.812949:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938162.813005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938162.813042:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938162.813057:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125223680 00000100:00100000:0.0:1784938162.813069:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125223680 00000100:00100000:3.0:1784938162.813075:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938162.813131:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938162.813153:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125223552 00000100:00100000:0.0:1784938162.813157:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125223552 00000100:00100000:3.0:1784938162.813166:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125223936 00000100:00100000:3.0:1784938162.813172:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125223936 00000100:00100000:0.0:1784938162.813187:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:0.0:1784938162.813200:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125223680:12345-192.168.203.26@tcp:400: 00000100:00100000:3.0:1784938162.813247:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125223808 00000100:00100000:3.0:1784938162.813251:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125223808 00000100:00100000:3.0:1784938162.813283:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:3.0:1784938162.813292:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125223936:12345-192.168.203.26@tcp:400: 00000100:00100000:0.0:1784938162.813327:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125223680:12345-192.168.203.26@tcp:400: Request processed in 129us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938162.813336:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:3.0:1784938162.813347:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125223936:12345-192.168.203.26@tcp:400: Request processed in 55us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938162.813360:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1784938162.813361:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1784938162.813377:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125223552:12345-192.168.203.26@tcp:400: 00000100:00100000:3.0:1784938162.813384:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:3.0:1784938162.813394:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125223808:12345-192.168.203.26@tcp:400: 00000100:00100000:0.0:1784938162.813409:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125223552:12345-192.168.203.26@tcp:400: Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938162.813416:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1784938162.813431:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125223808:12345-192.168.203.26@tcp:400: Request processed in 38us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938162.813439:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1784938162.813530:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125223424 00000100:00100000:2.0:1784938162.813535:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125223424 00000100:00100000:2.0:1784938162.813573:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:2.0:1784938162.813581:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125223424:12345-192.168.203.26@tcp:400: 00000100:00100000:2.0:1784938162.813613:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125223424:12345-192.168.203.26@tcp:400: Request processed in 33us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938162.813621:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00080000:2.0:1784938162.813657:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938162.813662:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938162.813665:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938162.813674:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1784938162.858455:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000001:00100000:1.0:1784938162.858680:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000100:00100000:2.0:1784938163.360459:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144149504:192.168.203.126@tcp:41: 00000100:00100000:2.0:1784938163.360907:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938163.360948:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144149504 00000100:00100000:2.0:1784938163.360957:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144149504 00000100:00100000:2.0:1784938163.361015:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 64 00000100:00100000:2.0:1784938163.361025:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144149504:12345-192.168.203.126@tcp:41: 00000004:00000024:2.0:1784938163.361067:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784938163.361119:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144149504:12345-192.168.203.126@tcp:41: Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938163.361127:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 64 00000100:00100000:2.0:1784938163.361302:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144149504:192.168.203.126@tcp:41: 00000001:02000400:2.0:1784938163.406041:0:10180:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784938163.809316:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784938163.876152:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00010000:00010000:0.0:1784938164.835387:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938164.895558:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938164.895595:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144149632:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938164.895956:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938164.895992:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144149632 00000100:00100000:1.0:1784938164.896001:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144149632 00000100:00100000:1.0:1784938164.896071:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:1.0:1784938164.896083:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144149632:12345-192.168.203.126@tcp:13: 00002000:00000024:1.0:1784938164.896121:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938164.896169:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144149632:12345-192.168.203.126@tcp:13: Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938164.896176:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00080000:1.0:1784938164.896200:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938164.898801:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144149888:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.898906:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144150400:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.898955:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144150912:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.899002:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784938164.899009:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144150016:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.899040:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144150528:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.899066:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144151040:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.899171:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144150144:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.899255:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144150656:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.899287:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144151168:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.899318:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938164.899334:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784938164.899343:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144149760:0@lo:400: 00000100:00100000:1.0:1784938164.899370:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938164.899392:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938164.899615:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938164.899654:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144150272:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.899700:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938164.899748:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144150784:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.899749:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938164.899809:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938164.899852:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938164.899883:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938164.899899:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938164.899921:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144150656 00000100:00100000:1.0:1784938164.899922:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938164.899934:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144150656 00000100:00100000:1.0:1784938164.899966:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938164.899992:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144149888 00000100:00100000:1.0:1784938164.899997:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144149888 00000100:00100000:3.0:1784938164.900009:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144151168 00000100:00100000:3.0:1784938164.900014:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144151168 00000100:00100000:1.0:1784938164.900025:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144150400 00000100:00100000:1.0:1784938164.900029:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144150400 00000100:00100000:3.0:1784938164.900041:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144150784 00000100:00100000:3.0:1784938164.900046:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144150784 00000100:00100000:1.0:1784938164.900049:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144150912 00000100:00100000:1.0:1784938164.900053:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144150912 00000100:00100000:1.0:1784938164.900074:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144150528 00000100:00100000:3.0:1784938164.900077:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:1.0:1784938164.900078:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144150528 00000100:00100000:3.0:1784938164.900091:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144150656:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.900095:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144151040 00000100:00100000:1.0:1784938164.900098:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144151040 00000100:00100000:1.0:1784938164.900112:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144150144 00000100:00100000:1.0:1784938164.900115:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144150144 00000100:00100000:1.0:1784938164.900129:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:1.0:1784938164.900137:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144149888:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.900169:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144150656:12345-192.168.203.126@tcp:400: Request processed in 81us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938164.900175:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144149888:12345-192.168.203.126@tcp:400: Request processed in 36us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938164.900183:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:1.0:1784938164.900186:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:1.0:1784938164.900209:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 59 00000100:00100000:1.0:1784938164.900244:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144150400:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.900267:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144150400:12345-192.168.203.126@tcp:400: Request processed in 53us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938164.900282:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 59 00000100:00100000:3.0:1784938164.900303:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:3.0:1784938164.900312:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144151168:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.900339:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144151168:12345-192.168.203.126@tcp:400: Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938164.900345:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:3.0:1784938164.900357:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:3.0:1784938164.900363:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144150784:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.900387:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144150784:12345-192.168.203.126@tcp:400: Request processed in 23us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938164.900394:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:3.0:1784938164.901357:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:3.0:1784938164.901374:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144150912:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.901438:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144150912:12345-192.168.203.126@tcp:400: Request processed in 70us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938164.901446:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:3.0:1784938164.901471:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 61 00000100:00100000:3.0:1784938164.901479:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144150528:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.901504:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144150528:12345-192.168.203.126@tcp:400: Request processed in 27us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938164.901523:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 61 00000100:00100000:3.0:1784938164.901534:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:3.0:1784938164.901552:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144151040:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.901578:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144151040:12345-192.168.203.126@tcp:400: Request processed in 27us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938164.901593:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:3.0:1784938164.901605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 63 00000100:00100000:3.0:1784938164.901612:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144150144:12345-192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.901634:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144150144:12345-192.168.203.126@tcp:400: Request processed in 23us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938164.901640:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 63 00000100:00100000:3.0:1784938164.901664:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144149760 00000100:00100000:3.0:1784938164.901673:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144149760 00000100:00100000:3.0:1784938164.901963:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1784938164.901972:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144149760:12345-0@lo:400: 00000100:00100000:3.0:1784938164.902044:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144149760:12345-0@lo:400: Request processed in 74us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938164.902051:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784938164.902395:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144150016 00000100:00100000:0.0:1784938164.902405:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144150016 00000100:00100000:0.0:1784938164.902520:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144150272 00000100:00100000:0.0:1784938164.902525:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144150272 00000100:00100000:0.0:1784938164.902548:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 65 00000100:00100000:0.0:1784938164.902559:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144150016:12345-192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.902668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 66 00000100:00100000:1.0:1784938164.902677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144150272:12345-192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938164.902761:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731180 x1871643144149632/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938164.902790:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144149632:192.168.203.126@tcp:13: 00000100:00100000:0.0:1784938164.905742:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144150016:12345-192.168.203.126@tcp:400: Request processed in 3167us (6023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938164.905761:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 65 00000100:00100000:1.0:1784938164.906047:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144150272:12345-192.168.203.126@tcp:400: Request processed in 3366us (6119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938164.906057:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 66 00000100:00100000:3.0:1784938164.906064:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144149760:0@lo:400: 00010000:00080000:3.0:1784938164.906094:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678ce00 x1871643144150784/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938164.906110:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144150784:192.168.203.126@tcp:400: 00000100:00100000:3.0:1784938164.906128:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144150144:192.168.203.126@tcp:400: 00000100:00080000:0.0:1784938164.906657:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938164.906666:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938164.906670:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938164.906673:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938164.907238:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144150016:192.168.203.126@tcp:400: 00010000:00080000:1.0:1784938164.907278:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfb2d4000 x1871643144150528/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938164.907291:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144150528:192.168.203.126@tcp:400: 00010000:00080000:1.0:1784938164.907305:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678d500 x1871643144151040/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938164.907316:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144151040:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.907332:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144149888:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.907345:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144150400:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.907358:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144150912:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938164.909037:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfb2d5f80 x1871643144150656/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938164.909064:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144150656:192.168.203.126@tcp:400: 00010000:00080000:3.0:1784938164.909101:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678ed80 x1871643144151168/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938164.909110:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144151168:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.910343:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144151296:192.168.203.126@tcp:13: 00000100:00100000:3.0:1784938164.910520:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144150272:192.168.203.126@tcp:400: 00000100:00100000:1.0:1784938164.910768:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938164.914678:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144151296 00000100:00100000:1.0:1784938164.914702:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144151296 00000100:00100000:1.0:1784938164.914822:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:1.0:1784938164.914845:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144151296:12345-192.168.203.126@tcp:13: 00002000:00000024:1.0:1784938164.914880:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938164.914976:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144151296:12345-192.168.203.126@tcp:13: Request processed in 134us (4208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938164.914983:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 25 00010000:00080000:1.0:1784938164.915495:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd458700 x1871643144151296/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938164.915533:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144151296:192.168.203.126@tcp:13: 00010000:00010000:3.0:1784938165.856399:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938165.922799:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938165.922836:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144151424:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938165.923182:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938165.923238:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144151424 00000100:00100000:1.0:1784938165.923247:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144151424 00000100:00100000:1.0:1784938165.923302:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:1.0:1784938165.923313:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144151424:12345-192.168.203.126@tcp:13: 00002000:00000024:1.0:1784938165.923352:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938165.923409:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144151424:12345-192.168.203.126@tcp:13: Request processed in 97us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938165.923417:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 26 00010000:00080000:1.0:1784938165.924189:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc676df80 x1871643144151424/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938165.924237:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144151424:192.168.203.126@tcp:13: 00000100:00100000:1.0:1784938165.930191:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144151552:192.168.203.126@tcp:13: 00000100:00100000:0.0:1784938165.931977:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938165.932015:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144151552 00000100:00100000:0.0:1784938165.932024:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144151552 00000100:00100000:0.0:1784938165.932077:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:0.0:1784938165.932087:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144151552:12345-192.168.203.126@tcp:13: 00002000:00000024:0.0:1784938165.932117:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938165.932200:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144151552:12345-192.168.203.126@tcp:13: Request processed in 114us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938165.932208:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 27 00010000:00080000:1.0:1784938165.941173:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd459180 x1871643144151552/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938165.941407:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144151552:192.168.203.126@tcp:13: 00010000:00010000:1.0:1784938166.884918:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938166.943647:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938166.943689:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144151680:192.168.203.126@tcp:41: 00000100:00100000:3.0:1784938166.944034:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938166.944073:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144151680 00000100:00100000:3.0:1784938166.944083:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144151680 00000100:00100000:3.0:1784938166.944147:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 67 00000100:00100000:3.0:1784938166.944157:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144151680:12345-192.168.203.126@tcp:41: 00000004:00000024:3.0:1784938166.944206:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784938166.944304:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144151680:12345-192.168.203.126@tcp:41: Request processed in 147us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938166.944311:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 67 00000100:00100000:3.0:1784938166.944491:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144151680:192.168.203.126@tcp:41: 00000020:00000080:0.0:1784938167.139415:0:10328:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1a3d56f0 20000000:00000080:0.0:1784938167.139433:0:10328:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910cffbbc800 uarg=0000000000000000 20000000:01000000:0.0:1784938167.139479:0:10328:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1784938167.139482:0:10328:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1784938167.139484:0:10328:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784938167.139490:0:10328:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784938167.139506:0:10328:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1784938167.139564:0:10328:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784938167.139567:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784938167.145602:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1784938167.150019:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1784938167.150058:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1784938167.150076:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1784938167.150097:0:10328:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784938167.150100:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784938167.151984:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1784938167.152864:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1784938167.152976:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1784938167.153003:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1784938167.153030:0:10328:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1784938167.153034:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784938167.153647:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1784938167.154052:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1784938167.154079:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1784938167.154097:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1784938167.154110:0:10328:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1784938167.154112:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784938167.154655:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1784938167.154834:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1784938167.154860:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1784938167.154877:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1784938167.154887:0:10328:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784938167.154889:0:10328:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784938167.155593:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1784938167.155813:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1784938167.155835:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1784938167.155849:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:0.0:1784938167.155865:0:10328:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784938167.155882:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.155900:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee132 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.155977:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee15c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.155995:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee19b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156003:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee1a9 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156010:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee1b7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156017:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee1d3 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156024:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee1f6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156031:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee219 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156039:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee243 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156048:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f0 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156056:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f7 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156064:0:10328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156111:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f7 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156126:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f7 expref: 9 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.156140:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144151808:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938167.156519:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f0 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156529:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f0 expref: 9 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.156538:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144151936:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938167.156588:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee243 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156596:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee243 expref: 23 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.156606:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152064:0@lo:104: 00000100:00100000:0.0:1784938167.156642:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938167.156676:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee219 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156685:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee219 expref: 23 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.156705:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152192:0@lo:104: 00000100:00100000:0.0:1784938167.156729:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938167.156752:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee1f6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156761:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee1f6 expref: 23 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.156769:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152320:0@lo:104: 00000100:00100000:0.0:1784938167.156792:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938167.156823:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee1d3 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156832:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee1d3 expref: 23 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.156840:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152448:0@lo:104: 00000100:00100000:0.0:1784938167.156866:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938167.156882:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee1b7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.156892:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee1b7 expref: 23 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.156900:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152576:0@lo:104: 00010000:00010000:0.0:1784938167.157130:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee1a9 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.157149:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee1a9 expref: 23 pid: 6507 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.157158:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152704:0@lo:104: 00010000:00010000:0.0:1784938167.157182:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee19b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.157190:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee19b expref: 23 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.157199:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152832:0@lo:104: 00000100:00100000:2.0:1784938167.158044:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784938167.158076:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938167.158094:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938167.158104:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938167.158116:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144152064 00000100:00100000:2.0:1784938167.158123:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144152064 00000100:00100000:2.0:1784938167.158247:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144152192 00000100:00100000:2.0:1784938167.158252:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144152192 00000100:00100000:2.0:1784938167.158268:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144152320 00000100:00100000:2.0:1784938167.158271:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144152320 00000100:00100000:2.0:1784938167.158295:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144152448 00000100:00100000:2.0:1784938167.158297:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144152448 00000100:00100000:2.0:1784938167.158306:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144152576 00000100:00100000:2.0:1784938167.158309:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144152576 00000100:00100000:2.0:1784938167.158318:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144152704 00000100:00100000:2.0:1784938167.158320:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144152704 00000100:00100000:2.0:1784938167.158328:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144152832 00000100:00100000:2.0:1784938167.158331:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144152832 00000100:00100000:2.0:1784938167.158344:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784938167.158352:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:10328:x1871643144152064:12345-0@lo:104: 00010000:00010000:2.0:1784938167.158367:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938167.158427:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938167.158433:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:10328:x1871643144152064:12345-0@lo:104: Request processed in 83us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.158440:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784938167.158459:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784938167.158465:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+8:10328:x1871643144152192:12345-0@lo:104: 00010000:00010000:2.0:1784938167.158472:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938167.158850:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee15c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938167.158864:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee15c expref: 23 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.158877:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152960:0@lo:104: 00000100:00100000:1.0:1784938167.159050:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784938167.159081:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee132 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938167.159089:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee132 expref: 23 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.159098:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144153088:0@lo:104: 00000100:00100000:1.0:1784938167.159121:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938167.159131:0:10328:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674b780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938167.159154:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152064:0@lo:104: 00000100:00100000:1.0:1784938167.159385:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4837480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152192:0@lo:104: 00010000:00010000:2.0:1784938167.159843:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784938167.159853:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+8:10328:x1871643144152192:12345-0@lo:104: Request processed in 1386us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.159861:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784938167.159885:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144152960 00000100:00100000:2.0:1784938167.159890:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144152960 00000100:00100000:2.0:1784938167.159921:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144153088 00000100:00100000:2.0:1784938167.159924:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144153088 00000100:00100000:2.0:1784938167.159951:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784938167.159958:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:10328:x1871643144152320:12345-0@lo:104: 00010000:00010000:2.0:1784938167.159969:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.160082:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152320:0@lo:104: 00010000:00010000:0.0:1784938167.160653:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938167.160670:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160679:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910bc7469800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938167.160683:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160693:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938167.160700:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938167.160706:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938167.160756:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160773:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938167.160805:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160813:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee24a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160828:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938167.160831:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160837:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938167.160840:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160847:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938167.160854:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938167.160859:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938167.160873:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160879:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938167.160894:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160900:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d020d0c00/0x26783cd1c59ee219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee220 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160929:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938167.160932:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160939:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1600 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938167.160941:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160949:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938167.160955:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938167.160960:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938167.160974:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160980:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938167.160984:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.160990:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee1f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee204 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161000:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938167.161002:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938167.161004:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938167.161014:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938167.161033:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144153216:0@lo:103: 00000100:00100000:0.0:1784938167.161078:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938167.161117:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144153344:0@lo:103: 00000100:00100000:0.0:1784938167.161138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938167.161154:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938167.161158:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144153472:0@lo:103: 00000100:00100000:0.0:1784938167.161395:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938167.161433:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144153216 00000100:00100000:0.0:1784938167.161438:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144153216 00010000:00010000:0.0:1784938167.161461:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee243 expref: 24 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.161484:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144153344 00000100:00100000:0.0:1784938167.161487:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144153344 00010000:00010000:0.0:1784938167.161508:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee219 expref: 25 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.161524:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144153472 00000100:00100000:0.0:1784938167.161526:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144153472 00010000:00010000:0.0:1784938167.161536:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee1f6 expref: 26 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.161548:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784938167.161555:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+26:3642:x1871643144153216:12345-0@lo:103: 00010000:00010000:0.0:1784938167.161565:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938167.161570:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee243 expref: 26 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161578:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee243 expref: 26 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161602:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee24a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee243 expref: 26 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161615:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938167.161647:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+25:3642:x1871643144153216:12345-0@lo:103: Request processed in 92us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938167.161655:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784938167.161763:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938167.161770:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144153344:12345-0@lo:103: 00010000:00010000:0.0:1784938167.161778:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938167.161783:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee219 expref: 24 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161791:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee219 expref: 24 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161801:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d1400/0x26783cd1c59ee220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee219 expref: 24 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161811:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938167.161837:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3640:x1871643144153344:12345-0@lo:103: Request processed in 68us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938167.161843:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938167.161855:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784938167.161861:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3640:x1871643144153472:12345-0@lo:103: 00010000:00010000:0.0:1784938167.161868:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938167.161872:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee1f6 expref: 22 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161887:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee1f6 expref: 22 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161896:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d0215b800/0x26783cd1c59ee204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee1f6 expref: 22 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.161964:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938167.161988:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3640:x1871643144153472:12345-0@lo:103: Request processed in 127us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938167.161993:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784938167.162039:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144153216:0@lo:103: 00000100:00100000:0.0:1784938167.162062:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144153472:0@lo:103: 00000100:00100000:0.0:1784938167.162069:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144153344:0@lo:103: 00010000:00010000:2.0:1784938167.162629:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1784938167.162638:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+9:10328:x1871643144152320:12345-0@lo:104: Request processed in 2679us (5844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.162646:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1784938167.162744:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938167.162784:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784938167.162794:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+8:10328:x1871643144152448:12345-0@lo:104: 00010000:00010000:2.0:1784938167.162806:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938167.162937:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938167.162943:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+8:10328:x1871643144152448:12345-0@lo:104: Request processed in 152us (6076us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.162949:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784938167.162991:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784938167.162998:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+7:10328:x1871643144152576:12345-0@lo:104: 00010000:00010000:2.0:1784938167.163006:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938167.163045:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784938167.163051:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+7:10328:x1871643144152576:12345-0@lo:104: Request processed in 54us (4977us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.163057:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784938167.163079:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784938167.163085:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+6:10328:x1871643144152704:12345-0@lo:104: 00010000:00010000:2.0:1784938167.163095:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938167.163124:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784938167.163129:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+6:10328:x1871643144152704:12345-0@lo:104: Request processed in 45us (5034us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.163135:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784938167.163148:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784938167.163153:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+5:10328:x1871643144152832:12345-0@lo:104: 00010000:00010000:0.0:1784938167.163252:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938167.163258:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163265:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77c00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938167.163269:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163277:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938167.163284:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938167.163300:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938167.163330:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163337:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938167.163348:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163355:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b77c00/0x26783cd1c59ee1d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163368:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938167.163371:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163378:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0400 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938167.163381:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163388:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938167.163394:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938167.163399:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938167.163412:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163418:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938167.163429:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163435:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d020d0400/0x26783cd1c59ee1b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1be expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163444:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938167.163447:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163452:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938167.163455:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163461:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938167.163466:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938167.163471:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938167.163481:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163486:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938167.163508:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163514:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee1a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163522:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938167.163528:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938167.163530:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938167.163537:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938167.163548:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144153856:0@lo:103: 00000100:00100000:0.0:1784938167.163580:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938167.163615:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144153600:0@lo:103: 00000100:00100000:0.0:1784938167.163634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938167.163647:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938167.163652:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144153728:0@lo:103: 00000100:00100000:0.0:1784938167.163680:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938167.163699:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144153856 00000100:00100000:0.0:1784938167.163704:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144153856 00010000:00010000:0.0:1784938167.163723:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee1a9 expref: 21 pid: 6507 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.163741:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144153600 00000100:00100000:0.0:1784938167.163743:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144153600 00010000:00010000:0.0:1784938167.163752:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee1d3 expref: 22 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.163763:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144153728 00000100:00100000:0.0:1784938167.163765:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144153728 00010000:00010000:0.0:1784938167.163773:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee1b7 expref: 23 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.163784:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938167.163789:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3641:x1871643144153856:12345-0@lo:103: 00010000:00010000:0.0:1784938167.163797:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938167.163801:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee1a9 expref: 23 pid: 6507 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163819:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee1a9 expref: 23 pid: 6507 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163832:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938167.163856:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3641:x1871643144153856:12345-0@lo:103: Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938167.163862:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938167.163875:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784938167.163880:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3642:x1871643144153600:12345-0@lo:103: 00010000:00010000:0.0:1784938167.163886:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938167.163890:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee1d3 expref: 22 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163898:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee1d3 expref: 22 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163906:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938167.163926:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3642:x1871643144153600:12345-0@lo:103: Request processed in 46us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938167.163931:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784938167.163941:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938167.163947:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3642:x1871643144153728:12345-0@lo:103: 00010000:00010000:0.0:1784938167.163953:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938167.163957:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee1b7 expref: 21 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163964:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee1b7 expref: 21 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.163978:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938167.163996:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3642:x1871643144153728:12345-0@lo:103: Request processed in 50us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938167.164002:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938167.164037:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144153856:0@lo:103: 00000100:00100000:0.0:1784938167.164059:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144153728:0@lo:103: 00000100:00100000:0.0:1784938167.164066:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144153600:0@lo:103: 00010000:00010000:2.0:1784938167.164286:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938167.164338:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938167.164344:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+5:10328:x1871643144152832:12345-0@lo:104: Request processed in 1191us (6239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.164350:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784938167.164367:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784938167.164374:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:10328:x1871643144152960:12345-0@lo:104: 00010000:00010000:2.0:1784938167.164382:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938167.164411:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784938167.164416:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:10328:x1871643144152960:12345-0@lo:104: Request processed in 43us (5367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.164421:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784938167.164442:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784938167.164448:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:10328:x1871643144153088:12345-0@lo:104: 00010000:00010000:2.0:1784938167.164455:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938167.164480:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784938167.164484:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:10328:x1871643144153088:12345-0@lo:104: Request processed in 37us (5363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.164489:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1784938167.164798:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938167.164804:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164811:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1000 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938167.164815:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164823:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938167.164831:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938167.164837:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938167.164857:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164864:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938167.164878:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164891:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ee19b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee1a2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164914:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938167.164917:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164923:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1e00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938167.164927:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164933:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938167.164940:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938167.164945:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938167.164956:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164962:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938167.164971:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164978:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ee15c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee163 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.164987:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938167.164996:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165001:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938167.165004:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165011:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938167.165017:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938167.165022:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938167.165033:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165038:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938167.165043:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165049:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ee132 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee139 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165062:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938167.165063:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938167.165065:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938167.165071:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938167.165080:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144153984:0@lo:103: 00000100:00100000:0.0:1784938167.165113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938167.165144:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144154112:0@lo:103: 00000100:00100000:0.0:1784938167.165186:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938167.165203:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938167.165208:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144154240:0@lo:103: 00000100:00100000:0.0:1784938167.165247:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938167.165275:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144153984 00000100:00100000:0.0:1784938167.165280:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144153984 00010000:00010000:0.0:1784938167.165301:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee19b expref: 21 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.165322:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144154112 00000100:00100000:0.0:1784938167.165325:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144154112 00010000:00010000:0.0:1784938167.165335:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee15c expref: 22 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.165349:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144154240 00000100:00100000:0.0:1784938167.165352:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144154240 00010000:00010000:0.0:1784938167.165361:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee132 expref: 23 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938167.165371:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938167.165377:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3640:x1871643144153984:12345-0@lo:103: 00010000:00010000:0.0:1784938167.165386:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938167.165390:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee19b expref: 23 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165399:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee19b expref: 23 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165411:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938167.165437:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3640:x1871643144153984:12345-0@lo:103: Request processed in 60us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938167.165450:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938167.165462:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938167.165467:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3642:x1871643144154112:12345-0@lo:103: 00010000:00010000:0.0:1784938167.165474:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938167.165478:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee15c expref: 22 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165486:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee15c expref: 22 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165505:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938167.165529:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3642:x1871643144154112:12345-0@lo:103: Request processed in 62us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938167.165534:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938167.165563:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938167.165569:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3642:x1871643144154240:12345-0@lo:103: 00010000:00010000:0.0:1784938167.165575:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938167.165579:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee132 expref: 21 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165587:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee132 expref: 21 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.165595:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938167.165614:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3642:x1871643144154240:12345-0@lo:103: Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938167.165619:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938167.165655:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144153984:0@lo:103: 00000100:00100000:0.0:1784938167.165822:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144154240:0@lo:103: 00000100:00100000:0.0:1784938167.165830:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144154112:0@lo:103: 00010000:00010000:3.0:1784938167.166043:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938167.166106:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938167.166261:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938167.166283:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125224064 00000100:00100000:3.0:1784938167.166288:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125224064 00010000:00010000:3.0:1784938167.166478:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f7 expref: 10 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938167.166508:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125224192 00000100:00100000:3.0:1784938167.166511:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125224192 00010000:00010000:3.0:1784938167.166524:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f0 expref: 11 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938167.166542:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:3.0:1784938167.166550:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:2393:x1871643125224064:12345-192.168.203.26@tcp:103: 00010000:00010000:3.0:1784938167.166558:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938167.166562:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f7 expref: 11 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166572:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f7 expref: 11 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166597:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938167.166637:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:2393:x1871643125224064:12345-192.168.203.26@tcp:103: Request processed in 88us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938167.166644:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:3.0:1784938167.166726:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:3.0:1784938167.166734:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125224192:12345-192.168.203.26@tcp:103: 00010000:00010000:3.0:1784938167.166741:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938167.166746:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f0 expref: 10 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166755:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f0 expref: 10 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166766:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166774:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166787:0:7921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166794:0:7921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166801:0:7921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166807:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166820:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938167.166824:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166831:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166840:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938167.166850:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938167.166869:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125224192:12345-192.168.203.26@tcp:103: Request processed in 137us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938167.166875:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00010000:00010000:2.0:1784938167.167545:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938167.167639:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1a00/0x26783cd1c59ee1da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee1d3 expref: 20 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.167653:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152448:0@lo:104: 00010000:00010000:1.0:1784938167.167691:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee1be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee1b7 expref: 19 pid: 6506 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.167700:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152576:0@lo:104: 00010000:00010000:1.0:1784938167.167710:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d0215b600/0x26783cd1c59ee1b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee1a9 expref: 18 pid: 6507 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.167718:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152704:0@lo:104: 00010000:00010000:1.0:1784938167.167728:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d1600/0x26783cd1c59ee1a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee19b expref: 17 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.167737:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152832:0@lo:104: 00010000:00010000:1.0:1784938167.167749:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77e00/0x26783cd1c59ee163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee15c expref: 16 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.167757:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144152960:0@lo:104: 00010000:00010000:1.0:1784938167.167769:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ee139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee132 expref: 15 pid: 6505 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.167776:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144153088:0@lo:104: 00010000:00010000:1.0:1784938167.167790:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee25f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f7 expref: 9 pid: 6505 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.167798:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144151808:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938167.167807:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ee258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a284f0 expref: 8 pid: 6506 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938167.167816:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10328:1871643144151936:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938167.167860:0:10328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938167.167870:0:10328:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938167.167875:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938167.167882:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ee29e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938167.905432:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938167.927396:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938167.927545:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938167.927587:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938167.927624:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938167.927686:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125224704 00000100:00100000:2.0:1784938167.927696:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125224320 00000100:00100000:1.0:1784938167.927700:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125224704 00000100:00100000:2.0:1784938167.927714:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125224320 00000100:00100000:2.0:1784938167.927793:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00100000:1.0:1784938167.927802:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1784938167.927811:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:2392:x1871643125224320:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1784938167.927824:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125224704:12345-192.168.203.26@tcp:400: 00000100:00100000:2.0:1784938167.927907:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:2392:x1871643125224320:12345-192.168.203.26@tcp:400: Request processed in 102us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938167.927914:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125224704:12345-192.168.203.26@tcp:400: Request processed in 92us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938167.927925:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00100000:1.0:1784938167.927936:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00080000:1.0:1784938167.928004:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938167.934529:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938167.935360:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125224832 00000100:00100000:1.0:1784938167.935377:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125224832 00000100:00100000:1.0:1784938167.935479:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:1.0:1784938167.935574:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125224832:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1784938167.935692:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125224832:12345-192.168.203.26@tcp:400: Request processed in 202us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938167.935702:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:0.0:1784938167.936671:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125224448 00000100:00100000:0.0:1784938167.936687:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125224448 00000100:00100000:0.0:1784938167.936818:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125224576 00000100:00100000:0.0:1784938167.936822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125224576 00000100:00100000:1.0:1784938167.936869:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:1.0:1784938167.936903:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125224448:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1784938167.936987:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125224448:12345-192.168.203.26@tcp:400: Request processed in 88us (9607us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938167.936995:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:1.0:1784938167.937015:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1784938167.937022:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125224576:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1784938167.937292:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125224576:12345-192.168.203.26@tcp:400: Request processed in 269us (9666us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938167.937301:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00080000:2.0:1784938167.939765:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938167.939782:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938167.939787:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:1.0:1784938168.418141:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938168.418153:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cece6d800 from 48 10000000:01000000:1.0:1784938168.418161:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938168.418262:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.418276:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.418290:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.418320:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144154368:0@lo:101: 00000100:00100000:1.0:1784938168.418421:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.418479:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144154368 00000100:00100000:3.0:1784938168.418505:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144154368 00000100:00100000:1.0:1784938168.418506:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.418605:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1784938168.418618:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+15:6510:x1871643144154368:12345-0@lo:101: 00010000:00010000:1.0:1784938168.418638:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938168.418672:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee2ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee2a5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.418704:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee2a5 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.418717:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee2a5 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.418728:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1e00, rc 0) 00000100:00100000:1.0:1784938168.418790:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144154368:12345-0@lo:101: Request processed in 175us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.418797:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784938168.420348:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144154368:0@lo:101: 00010000:00010000:0.0:1784938168.420384:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.420400:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938168.420522:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144154496:0@lo:501: 00000100:00100000:0.0:1784938168.420593:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938168.420645:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674be40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.420666:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144154496 00000100:00100000:1.0:1784938168.420675:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144154496 00000100:00100000:1.0:1784938168.420736:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1784938168.420749:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144154496:12345-0@lo:501: 00000100:00100000:1.0:1784938168.420945:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144154496:12345-0@lo:501: Request processed in 198us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.420954:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1784938168.421016:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144154496:0@lo:501: 00000100:00100000:0.0:1784938168.421047:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144154624:0@lo:503: 00000100:00100000:0.0:1784938168.421103:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938168.421124:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674be40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.421149:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144154624 00000100:00100000:3.0:1784938168.421154:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144154624 00000100:00100000:3.0:1784938168.421182:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784938168.421187:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144154624:12345-0@lo:503: 00000100:00100000:3.0:1784938168.421308:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144154624:12345-0@lo:503: Request processed in 121us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.421314:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784938168.421536:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144154624:0@lo:503: 00000100:00100000:0.0:1784938168.421967:0:10345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10345:1871643144154752:0@lo:502: 00000100:00100000:0.0:1784938168.422012:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.422046:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144154752 00000100:00100000:0.0:1784938168.422049:0:10345:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674b240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.422052:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144154752 00000100:00100000:1.0:1784938168.422084:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1784938168.422090:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:10345:x1871643144154752:12345-0@lo:502: 00000100:00100000:1.0:1784938168.422190:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:10345:x1871643144154752:12345-0@lo:502: Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.422195:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784938168.422304:0:10345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10345:1871643144154752:0@lo:502: 00000100:00100000:0.0:1784938168.422344:0:10345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10345:1871643144154880:0@lo:502: 00000100:00100000:0.0:1784938168.422376:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938168.422400:0:10345:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674b240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.422425:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144154880 00000100:00100000:3.0:1784938168.422431:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144154880 00000100:00100000:3.0:1784938168.422460:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1784938168.422465:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:10345:x1871643144154880:12345-0@lo:502: 00000100:00100000:3.0:1784938168.422556:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+16:10345:x1871643144154880:12345-0@lo:502: Request processed in 90us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.422562:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784938168.422758:0:10345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10345:1871643144154880:0@lo:502: 00000040:00080000:0.0:1784938168.422778:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784938168.422874:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1784938168.422899:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938168.422918:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.422931:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938168.422943:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784938168.422946:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1784938168.422949:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784938168.422982:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.422989:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.422996:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.423006:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155008:0@lo:101: 00000100:00100000:1.0:1784938168.423032:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.423055:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.423101:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144155008 00000100:00100000:3.0:1784938168.423105:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144155008 00000100:00100000:3.0:1784938168.423132:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1784938168.423137:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+16:6510:x1871643144155008:12345-0@lo:101: 00010000:00010000:3.0:1784938168.423145:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938168.423158:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc0030600/0x26783cd1c59ee2ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee2b3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.423180:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc0030600/0x26783cd1c59ee2ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee2b3 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.423188:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc0030600/0x26783cd1c59ee2ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee2b3 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.423195:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc0030600, rc 0) 00000100:00100000:3.0:1784938168.423273:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144155008:12345-0@lo:101: Request processed in 134us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.423278:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784938168.423328:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155008:0@lo:101: 00010000:00010000:1.0:1784938168.423340:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.423347:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.423394:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155136:0@lo:501: 00000100:00100000:1.0:1784938168.423431:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.423494:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.423531:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144155136 00000100:00100000:3.0:1784938168.423536:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144155136 00000100:00100000:3.0:1784938168.423590:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1784938168.423595:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144155136:12345-0@lo:501: 00000100:00100000:3.0:1784938168.423717:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144155136:12345-0@lo:501: Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.423722:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1784938168.423763:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155136:0@lo:501: 00000100:00100000:0.0:1784938168.423796:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155264:0@lo:503: 00000100:00100000:0.0:1784938168.423841:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938168.423866:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674b240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.423910:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144155264 00000100:00100000:1.0:1784938168.424005:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144155264 00000100:00100000:1.0:1784938168.424029:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1784938168.424036:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144155264:12345-0@lo:503: 00000100:00100000:1.0:1784938168.424129:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144155264:12345-0@lo:503: Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.424135:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1784938168.424334:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155264:0@lo:503: 00000100:00100000:0.0:1784938168.424909:0:10346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10346:1871643144155392:0@lo:502: 00000100:00100000:0.0:1784938168.425042:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.425077:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144155392 00000100:00100000:0.0:1784938168.425082:0:10346:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.425084:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144155392 00000100:00100000:1.0:1784938168.425119:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1784938168.425127:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:10346:x1871643144155392:12345-0@lo:502: 00000100:00100000:1.0:1784938168.425252:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:10346:x1871643144155392:12345-0@lo:502: Request processed in 124us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.425260:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784938168.425283:0:10346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10346:1871643144155392:0@lo:502: 00000020:01000000:0.0:1784938168.425314:0:10346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938168.425326:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938168.425329:0:10346:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784938168.425335:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784938168.425359:0:10346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10346:1871643144155520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938168.425393:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938168.425423:0:10346:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.425499:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144155520 00000100:00100000:3.0:1784938168.425504:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144155520 00000100:00100000:3.0:1784938168.425539:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784938168.425549:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:10346:x1871643144155520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.425630:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+17:10346:x1871643144155520:12345-0@lo:502:llog_process_th.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.425635:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784938168.425753:0:10346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10346:1871643144155520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938168.425773:0:10346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938168.425783:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938168.425785:0:10346:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784938168.425789:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1784938168.425864:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1784938168.425895:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784938168.425907:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.425919:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938168.425927:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938168.425930:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cfd213000 from 48 10000000:01000000:1.0:1784938168.425932:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938168.425957:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.425968:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.425976:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.425985:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.426007:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.426025:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.426065:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144155648 00000100:00100000:3.0:1784938168.426069:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144155648 00000100:00100000:3.0:1784938168.426091:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1784938168.426096:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+17:6510:x1871643144155648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938168.426103:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938168.426114:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc0031e00/0x26783cd1c59ee2c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee2c1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.426133:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc0031e00/0x26783cd1c59ee2c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee2c1 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.426141:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc0031e00/0x26783cd1c59ee2c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee2c1 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.426148:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc0031e00, rc 0) 00000100:00100000:3.0:1784938168.426201:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144155648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.426205:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784938168.426321:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938168.426333:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.426340:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.426384:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.426409:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.426466:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.426511:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144155776 00000100:00100000:3.0:1784938168.426515:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144155776 00000100:00100000:3.0:1784938168.426539:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1784938168.426546:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144155776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.426723:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144155776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.426728:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1784938168.426809:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.426828:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.426867:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.426909:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144155904 00000100:00100000:3.0:1784938168.426913:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144155904 00000100:00100000:1.0:1784938168.426914:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.426940:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1784938168.426947:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144155904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.427022:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144155904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.427029:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784938168.427045:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144155904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.427699:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10347:1871643144156032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.427738:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.427765:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.427785:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144156032 00000100:00100000:2.0:1784938168.427792:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144156032 00000100:00100000:2.0:1784938168.427827:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1784938168.427837:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:10347:x1871643144156032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938168.427967:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:10347:x1871643144156032:12345-0@lo:502:llog_process_th.0 Request processed in 131us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.427976:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1784938168.427983:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10347:1871643144156032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.428024:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10347:1871643144156160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.428048:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.428069:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.428092:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144156160 00000100:00100000:1.0:1784938168.428101:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144156160 00000100:00100000:1.0:1784938168.428132:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784938168.428140:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:10347:x1871643144156160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938168.428285:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+18:10347:x1871643144156160:12345-0@lo:502:llog_process_th.0 Request processed in 146us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.428292:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1784938168.428296:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10347:1871643144156160:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784938168.428314:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784938168.428522:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1784938168.428552:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784938168.428562:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.428573:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938168.428583:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784938168.428587:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1784938168.428589:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784938168.428616:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.428624:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.428634:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938168.428648:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144156288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938168.428678:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938168.428711:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019ce180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.428762:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144156288 00000100:00100000:3.0:1784938168.428767:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144156288 00000100:00100000:3.0:1784938168.428839:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1784938168.428847:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+18:6510:x1871643144156288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938168.428857:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938168.428872:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc0030200/0x26783cd1c59ee2d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee2cf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.428897:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc0030200/0x26783cd1c59ee2d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee2cf expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.428908:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc0030200/0x26783cd1c59ee2d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee2cf expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.428917:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc0030200, rc 0) 00000100:00100000:3.0:1784938168.428955:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144156288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.428962:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784938168.428997:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144156288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938168.429016:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.429026:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.429082:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144156416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.429112:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938168.430738:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144156416 00000100:00100000:2.0:1784938168.430757:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144156416 00000100:00100000:1.0:1784938168.430787:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.430840:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1784938168.430853:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144156416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938168.431061:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144156416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.431069:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784938168.431161:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144156416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.431291:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144156544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.431347:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.431363:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938168.431671:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144156544 00000100:00100000:0.0:1784938168.431679:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144156544 00000100:00100000:0.0:1784938168.431729:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784938168.431739:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144156544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938168.431857:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144156544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938168.431865:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784938168.432089:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144156544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.433978:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10348:1871643144156672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.434102:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.434166:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.435309:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144156672 00000100:00100000:2.0:1784938168.435323:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144156672 00000100:00100000:2.0:1784938168.435418:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1784938168.435431:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+19:10348:x1871643144156672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938168.435667:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+19:10348:x1871643144156672:12345-0@lo:502:llog_process_th.0 Request processed in 238us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.435678:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1784938168.436328:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10348:1871643144156672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938168.436381:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938168.436395:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938168.436398:0:10348:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784938168.436420:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784938168.436466:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10348:1871643144156800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.436542:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.436593:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.436856:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144156800 00000100:00100000:2.0:1784938168.436863:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144156800 00000100:00100000:2.0:1784938168.436924:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1784938168.436933:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+19:10348:x1871643144156800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938168.437076:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+19:10348:x1871643144156800:12345-0@lo:502:llog_process_th.0 Request processed in 143us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.437084:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784938168.438376:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10348:1871643144156800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938168.438457:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938168.438468:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938168.438471:0:10348:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784938168.438478:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1784938168.438736:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1784938168.438763:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784938168.438777:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.438801:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938168.438814:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938168.438818:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cc481d800 from 48 10000000:01000000:1.0:1784938168.438821:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938168.438873:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.438882:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.438892:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.438928:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144156928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.439006:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.439068:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.439204:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144156928 00000100:00100000:2.0:1784938168.439257:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144156928 00000100:00100000:2.0:1784938168.439313:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1784938168.439324:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+19:6510:x1871643144156928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938168.439342:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938168.439359:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7468a00/0x26783cd1c59ee2e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee2dd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.439389:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7468a00/0x26783cd1c59ee2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee2dd expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.439402:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7468a00/0x26783cd1c59ee2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee2dd expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.439425:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7468a00, rc 0) 00000100:00100000:2.0:1784938168.439472:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144156928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.439480:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784938168.439632:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144156928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938168.439651:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.439660:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.439726:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.439755:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.439793:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.440040:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144157056 00000100:00100000:3.0:1784938168.440046:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144157056 00000100:00100000:3.0:1784938168.440078:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784938168.440087:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144157056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.440264:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144157056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.440272:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784938168.440388:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.440438:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.440499:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.440525:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.440591:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144157184 00000100:00100000:2.0:1784938168.440597:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144157184 00000100:00100000:2.0:1784938168.440627:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784938168.440635:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144157184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938168.440736:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144157184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.440743:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1784938168.440888:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.442183:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10349:1871643144157312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.444980:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.445055:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.445175:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144157312 00000100:00100000:2.0:1784938168.445189:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144157312 00000100:00100000:2.0:1784938168.445286:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784938168.445298:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:10349:x1871643144157312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938168.445510:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:10349:x1871643144157312:12345-0@lo:502:llog_process_th.0 Request processed in 214us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.445519:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784938168.447396:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10349:1871643144157312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.448270:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10349:1871643144157440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.450230:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.450361:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.450641:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144157440 00000100:00100000:2.0:1784938168.450653:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144157440 00000100:00100000:2.0:1784938168.450738:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784938168.450750:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:10349:x1871643144157440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938168.450977:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:10349:x1871643144157440:12345-0@lo:502:llog_process_th.0 Request processed in 228us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.450986:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784938168.451545:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10349:1871643144157440:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784938168.451596:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784938168.452550:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1784938168.452579:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938168.452595:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.452609:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938168.452621:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784938168.452624:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1784938168.452627:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784938168.452679:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.452689:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.452701:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.452731:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.452810:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.452886:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.452970:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144157568 00000100:00100000:2.0:1784938168.452982:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144157568 00000100:00100000:2.0:1784938168.453043:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784938168.453054:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144157568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938168.453072:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938168.453088:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7468600/0x26783cd1c59ee2f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee2eb expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.453115:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7468600/0x26783cd1c59ee2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee2eb expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.453126:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7468600/0x26783cd1c59ee2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee2eb expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.453136:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7468600, rc 0) 00000100:00100000:2.0:1784938168.453190:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144157568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.453198:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1784938168.453432:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938168.453449:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.453458:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938168.453535:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.453564:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.453593:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938168.453643:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144157696 00000100:00100000:0.0:1784938168.453648:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144157696 00000100:00100000:0.0:1784938168.453685:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1784938168.453693:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144157696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938168.453838:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144157696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938168.453846:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784938168.456699:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.456798:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.456911:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.456972:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938168.456988:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144157824 00000100:00100000:0.0:1784938168.457007:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144157824 00000100:00100000:0.0:1784938168.457083:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1784938168.457094:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144157824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938168.457310:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144157824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938168.457318:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1784938168.457498:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144157824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.458273:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10350:1871643144157952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938168.458335:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.458366:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.458438:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144157952 00000100:00100000:2.0:1784938168.458445:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144157952 00000100:00100000:2.0:1784938168.458493:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1784938168.458502:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:10350:x1871643144157952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938168.458631:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:10350:x1871643144157952:12345-0@lo:502:llog_process_th.0 Request processed in 129us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.458639:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784938168.458880:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10350:1871643144157952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938168.458921:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938168.458933:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938168.458936:0:10350:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784938168.458943:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784938168.458967:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10350:1871643144158080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938168.459000:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.459029:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938168.459086:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144158080 00000100:00100000:0.0:1784938168.459092:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144158080 00000100:00100000:0.0:1784938168.459126:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784938168.459134:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:10350:x1871643144158080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938168.459228:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:10350:x1871643144158080:12345-0@lo:502:llog_process_th.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938168.459236:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1784938168.459360:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10350:1871643144158080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938168.459376:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938168.459381:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938168.459382:0:10350:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784938168.459386:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1784938168.459676:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1784938168.459699:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784938168.459710:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.459724:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938168.459735:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784938168.459737:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cca3c9000 from 48 10000000:01000000:0.0:1784938168.459740:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784938168.459769:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.459778:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.459788:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938168.459802:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938168.459835:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938168.459864:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.464892:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144158208 00000100:00100000:1.0:1784938168.464927:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144158208 00000100:00100000:1.0:1784938168.465020:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784938168.465036:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144158208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938168.465063:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938168.465094:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee2f9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.465135:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee2f9 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.465150:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee2f9 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.465162:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1200, rc 0) 00000100:00100000:1.0:1784938168.465305:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144158208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (5467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.465313:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1784938168.465480:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938168.465535:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.465546:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938168.465653:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd45aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938168.465698:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938168.465741:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc6063180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938168.465911:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144158336 00000100:00100000:0.0:1784938168.465917:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144158336 00000100:00100000:0.0:1784938168.465965:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784938168.465984:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144158336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938168.466157:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144158336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938168.466166:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1784938168.466593:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd45aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.466642:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.466700:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.466739:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef3679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938168.467157:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144158464 00000100:00100000:0.0:1784938168.467165:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144158464 00000100:00100000:0.0:1784938168.467302:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1784938168.467313:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144158464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938168.471738:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144158464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4410us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938168.471757:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1784938168.474704:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938168.476024:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10351:1871643144158592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938168.476127:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938168.481154:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144158592 00000100:00100000:1.0:1784938168.481178:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144158592 00000100:00100000:0.0:1784938168.481306:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc6063180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.481407:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784938168.481421:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:10351:x1871643144158592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938168.482048:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:10351:x1871643144158592:12345-0@lo:502:llog_process_th.0 Request processed in 628us (5917us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.482068:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1784938168.482186:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10351:1871643144158592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938168.482395:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10351:1871643144158720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938168.482453:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938168.482530:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674b900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.482572:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144158720 00000100:00100000:1.0:1784938168.482578:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144158720 00000100:00100000:1.0:1784938168.482774:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1784938168.482786:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:10351:x1871643144158720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938168.482908:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:10351:x1871643144158720:12345-0@lo:502:llog_process_th.0 Request processed in 124us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.482916:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1784938168.482986:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10351:1871643144158720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784938168.483011:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784938168.484092:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1784938168.484136:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938168.484149:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.484161:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938168.484172:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784938168.484175:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1784938168.484178:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938168.484247:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.484257:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.484270:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938168.484299:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.484370:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.484926:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938168.484978:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144158848 00000100:00100000:0.0:1784938168.484988:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144158848 00000100:00100000:0.0:1784938168.486103:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1784938168.486127:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144158848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938168.486151:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938168.486175:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ee30e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee307 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.486269:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ee30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee307 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.486283:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ee30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee307 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.486295:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77c00, rc 0) 00000100:00100000:0.0:1784938168.486405:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144158848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938168.486414:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784938168.486562:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938168.486584:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.486594:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938168.486738:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.486781:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.490499:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938168.493310:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938168.493361:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144159104:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938168.495594:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938168.497601:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144158976 00000100:00100000:2.0:1784938168.497622:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144158976 00000100:00100000:2.0:1784938168.497717:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784938168.497730:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144158976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.498087:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144159104 00000100:00100000:1.0:1784938168.498095:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144159104 00000100:00100000:1.0:1784938168.498148:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 68 00000100:00100000:1.0:1784938168.498156:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144159104:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938168.498190:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938168.499163:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144159104:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 998us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.499177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 68 00000100:00100000:3.0:1784938168.499583:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144159104:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938168.502087:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144158976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4345us (15290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.502116:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1784938168.502405:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144158976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.502500:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144159232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.502587:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.502914:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef367f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938168.502973:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144159232 00000100:00100000:1.0:1784938168.502982:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144159232 00000100:00100000:1.0:1784938168.503083:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1784938168.503095:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144159232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938168.503417:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144159232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 323us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.503425:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1784938168.504097:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144159232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.505176:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10352:1871643144159360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.505299:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.505359:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef3679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.505444:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144159360 00000100:00100000:2.0:1784938168.505453:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144159360 00000100:00100000:2.0:1784938168.505517:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1784938168.505528:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:10352:x1871643144159360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938168.507955:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:10352:x1871643144159360:12345-0@lo:502:llog_process_th.0 Request processed in 2412us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.507975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1784938168.509173:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10352:1871643144159360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938168.509281:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938168.509299:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938168.509302:0:10352:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784938168.509311:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784938168.509366:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10352:1871643144159488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938168.509464:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.509544:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef3679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.509838:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144159488 00000100:00100000:2.0:1784938168.509854:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144159488 00000100:00100000:2.0:1784938168.509921:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784938168.509933:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:10352:x1871643144159488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938168.510127:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:10352:x1871643144159488:12345-0@lo:502:llog_process_th.0 Request processed in 196us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.510136:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1784938168.511164:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10352:1871643144159488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938168.511247:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938168.511262:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938168.511265:0:10352:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784938168.511272:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1784938168.511635:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1784938168.511669:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784938168.511856:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.511871:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938168.511884:0:6510:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784938168.511887:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff910cf3bf8000 from 1 10000000:01000000:0.0:1784938168.511890:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784938168.511942:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.511951:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938168.511962:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938168.512010:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144159616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938168.512172:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938168.512242:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938168.512450:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144159616 00000100:00100000:2.0:1784938168.512459:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144159616 00000100:00100000:2.0:1784938168.512533:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1784938168.512543:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144159616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938168.512560:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938168.512577:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7468800/0x26783cd1c59ee31c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee315 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.512625:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7468800/0x26783cd1c59ee31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee315 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.512639:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7468800/0x26783cd1c59ee31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee315 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.512649:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7468800, rc 0) 00000100:00100000:2.0:1784938168.513007:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144159616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 463us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.513015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784938168.513297:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144159616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938168.513319:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee31c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.513331:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee31c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938168.513424:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144159744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938168.513474:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938168.513535:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cef3679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938168.513891:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144159744 00000100:00100000:0.0:1784938168.513898:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144159744 00000100:00100000:0.0:1784938168.513952:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1784938168.513962:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144159744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938168.514077:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144159744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (601us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938168.514086:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784938168.514363:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144159744:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784938168.514433:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784938168.514461:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee31c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938168.514471:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee31c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.928170:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938169.657149:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938169.666556:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125224960 00000100:00100000:2.0:1784938169.666579:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125224960 00000100:00100000:2.0:1784938169.666685:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:2.0:1784938169.666698:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:6166:x1871643125224960:12345-192.168.203.26@tcp:101: 00010000:00010000:2.0:1784938169.666760:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938169.666786:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7469400/0x26783cd1c59ee323 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28567 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938169.666822:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7469400/0x26783cd1c59ee323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28567 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938169.666835:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7469400/0x26783cd1c59ee323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28567 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938169.666846:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7469400, rc 0) 00000100:00100000:2.0:1784938169.666934:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6166:x1871643125224960:12345-192.168.203.26@tcp:101: Request processed in 239us (9802us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938169.666941:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:1.0:1784938169.675846:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938169.675950:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125225088 00000100:00100000:3.0:1784938169.675964:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125225088 00000100:00100000:3.0:1784938169.676039:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:3.0:1784938169.676051:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6166:x1871643125225088:12345-192.168.203.26@tcp:501: 00000100:00100000:3.0:1784938169.676301:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6166:x1871643125225088:12345-192.168.203.26@tcp:501: Request processed in 251us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938169.676311:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:3.0:1784938169.690931:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938169.691089:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125225216 00000100:00100000:0.0:1784938169.691104:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125225216 00000100:00100000:0.0:1784938169.691174:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:0.0:1784938169.691185:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6166:x1871643125225216:12345-192.168.203.26@tcp:503: 00000100:00100000:0.0:1784938169.691415:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6166:x1871643125225216:12345-192.168.203.26@tcp:503: Request processed in 230us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938169.691424:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:0.0:1784938169.699667:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938169.699793:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125225344 00000100:00100000:2.0:1784938169.699808:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125225344 00000100:00100000:2.0:1784938169.699881:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 248 00000100:00100000:2.0:1784938169.699893:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6652:x1871643125225344:12345-192.168.203.26@tcp:502: 00000100:00100000:2.0:1784938169.700105:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6652:x1871643125225344:12345-192.168.203.26@tcp:502: Request processed in 213us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938169.700114:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 248 00000100:00100000:1.0:1784938169.709172:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938169.709350:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125225472 00000100:00100000:3.0:1784938169.709381:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125225472 00000100:00100000:3.0:1784938169.709456:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:3.0:1784938169.709467:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6652:x1871643125225472:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938169.709678:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6652:x1871643125225472:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 213us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938169.709687:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:3.0:1784938169.718887:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938169.719298:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125225600 00000100:00100000:0.0:1784938169.719312:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125225600 00000100:00100000:0.0:1784938169.719390:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:0.0:1784938169.719405:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6166:x1871643125225600:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938169.719430:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938169.719455:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee32a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2856e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938169.719532:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee32a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2856e expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938169.719544:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee32a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2856e expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938169.719556:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77400, rc 0) 00000100:00100000:0.0:1784938169.719636:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6166:x1871643125225600:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 235us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938169.719644:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:0.0:1784938169.724183:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938169.724421:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125225728 00000100:00100000:2.0:1784938169.724435:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125225728 00000100:00100000:2.0:1784938169.724518:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 251 00000100:00100000:2.0:1784938169.724530:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6166:x1871643125225728:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938169.725775:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6166:x1871643125225728:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 1235us (1595us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938169.725815:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 251 00010000:00010000:2.0:1784938169.951627:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938170.016422:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938170.016460:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144159872:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938170.017028:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938170.017566:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144159872 00000100:00100000:0.0:1784938170.017580:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144159872 00000100:00100000:0.0:1784938170.017795:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00100000:0.0:1784938170.017807:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144159872:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938170.017848:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938170.019043:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144159872:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 1230us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938170.019058:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00100000:0.0:1784938170.019128:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144160000:0@lo:400:kworker.0 00000100:00100000:0.0:1784938170.019232:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938170.019277:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144160512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938170.019558:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144160128:192.168.203.126@tcp:400:kworker.0 00000100:00080000:2.0:1784938170.019776:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938170.019817:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144160384:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938170.019958:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144160256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938170.020021:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144160640:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.023160:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144160896:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.023377:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144161408:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.023995:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938170.024026:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938170.024053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938170.024130:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938170.024164:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144160128 00000100:00100000:2.0:1784938170.024174:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144160128 00000100:00100000:2.0:1784938170.024383:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144160384 00000100:00100000:2.0:1784938170.024388:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144160384 00000100:00100000:2.0:1784938170.024445:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 66 00000100:00100000:2.0:1784938170.024456:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144160128:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.024546:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144160128:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 91us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938170.024555:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 66 00000100:00100000:2.0:1784938170.024576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 67 00000100:00100000:2.0:1784938170.024583:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144160384:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.024732:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144160384:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 148us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938170.024749:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 67 00000100:00100000:2.0:1784938170.024773:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144160896 00000100:00100000:2.0:1784938170.024776:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144160896 00000100:00100000:2.0:1784938170.024808:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144161408 00000100:00100000:2.0:1784938170.024811:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144161408 00000100:00100000:2.0:1784938170.024966:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:2.0:1784938170.024974:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144160896:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.025004:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144160896:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 31us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938170.025011:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:2.0:1784938170.025023:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:2.0:1784938170.025029:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144161408:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.025053:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144161408:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938170.025059:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00080000:2.0:1784938170.025093:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938170.025097:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938170.025602:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144160384:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938170.025633:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb7b480 x1871643144160896/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938170.025645:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144160896:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938170.025657:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb7a300 x1871643144161408/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938170.025666:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144161408:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.026081:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144160000 00000100:00100000:2.0:1784938170.026088:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144160000 00000100:00100000:2.0:1784938170.026131:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784938170.026138:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144160000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938170.026195:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144160000:12345-0@lo:400:kworker.0 Request processed in 57us (6980us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938170.026201:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784938170.028600:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938170.029575:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144160256 00000100:00100000:2.0:1784938170.029591:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144160256 00000100:00100000:3.0:1784938170.029842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938170.029871:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144160640 00000100:00100000:3.0:1784938170.029875:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144160640 00000100:00100000:2.0:1784938170.029934:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 69 00000100:00100000:2.0:1784938170.029948:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144160256:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938170.029952:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 68 00000100:00100000:3.0:1784938170.029966:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144160640:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938170.030070:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144160768:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938170.030199:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938170.030361:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144160256:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 416us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938170.030370:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 69 00000100:00080000:2.0:1784938170.030409:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938170.030454:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144160640:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 488us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938170.030463:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 68 00000100:00100000:3.0:1784938170.030497:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144160768 00000100:00100000:3.0:1784938170.030501:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144160768 00000100:00100000:3.0:1784938170.030540:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 69 00000100:00100000:3.0:1784938170.030550:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144160768:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.030589:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144160640:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.030600:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144161152:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.030679:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144160128:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938170.030692:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938170.030700:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144161536:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938170.030712:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144160768:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 47us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938170.030722:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 69 00000100:00080000:2.0:1784938170.030745:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938170.030862:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938170.030886:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938170.030907:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144161536 00000100:00100000:3.0:1784938170.030911:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144161536 00000100:00100000:3.0:1784938170.030940:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 29 00000100:00100000:3.0:1784938170.030948:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144161536:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938170.030967:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938170.031004:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144161536:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 57us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938170.031011:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 29 00000100:00100000:3.0:1784938170.031027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144161152 00000100:00100000:3.0:1784938170.031030:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144161152 00000100:00100000:3.0:1784938170.031057:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 70 00000100:00100000:3.0:1784938170.031063:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144161152:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938170.031110:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144161152:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 46us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938170.031117:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 70 00000100:00080000:3.0:1784938170.031135:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938170.032427:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144161024:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938170.032528:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144160000:0@lo:400:kworker.0 00010000:00080000:0.0:1784938170.032617:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587dc00 x1871643144160768/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938170.032630:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144160768:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938170.032639:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144161280:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938170.032683:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd459500 x1871643144159872/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938170.032700:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144159872:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938170.032726:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144160256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938170.032794:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938170.032825:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938170.032851:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938170.032881:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144160512 00000100:00100000:1.0:1784938170.032888:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144160512 00000100:00100000:1.0:1784938170.033692:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 70 00000100:00100000:1.0:1784938170.033710:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144160512:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938170.033798:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144160512:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 95us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938170.033807:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 70 00000100:00100000:1.0:1784938170.033841:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144161024 00000100:00100000:1.0:1784938170.033847:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144161024 00000100:00100000:1.0:1784938170.033890:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:1.0:1784938170.033927:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144161024:12345-192.168.203.126@tcp:400:kworker.0 00000100:00080000:0.0:1784938170.034092:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938170.035902:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678d500 x1871643144161536/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938170.035966:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144161536:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938170.035996:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144161152:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938170.036020:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144161280 00000100:00100000:3.0:1784938170.036029:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144161280 00000100:00100000:3.0:1784938170.036114:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 71 00000100:00100000:3.0:1784938170.036126:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144161280:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938170.036235:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144161280:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 110us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938170.036243:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 71 00000100:00080000:3.0:1784938170.036271:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938170.036773:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144161024:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 2847us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938170.036780:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 27 00010000:00080000:1.0:1784938170.037041:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb78700 x1871643144161280/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938170.037053:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144161280:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938170.038197:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144160512:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938170.038269:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb79c00 x1871643144161024/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938170.038281:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144161024:192.168.203.126@tcp:400:kworker.0 00010000:00010000:0.0:1784938170.978261:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938171.041487:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938171.041532:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144161664:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938171.042402:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938171.042442:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144161664 00000100:00100000:3.0:1784938171.042451:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144161664 00000100:00100000:3.0:1784938171.042531:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00100000:3.0:1784938171.042543:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144161664:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938171.042584:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938171.042642:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144161664:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 100us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938171.042652:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 30 00010000:00080000:1.0:1784938171.044445:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb7ad80 x1871643144161664/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938171.044495:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144161664:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938171.044806:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938171.044823:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144161792:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938171.046298:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938171.046342:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144161792 00000100:00100000:1.0:1784938171.046352:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144161792 00000100:00100000:1.0:1784938171.046412:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:1.0:1784938171.046422:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144161792:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938171.046453:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938171.048090:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144161792:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 1651us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938171.048106:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 31 00010000:00080000:1.0:1784938171.050410:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd459180 x1871643144161792/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938171.050479:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144161792:192.168.203.126@tcp:13:osp-pre-0-1.0 00000020:00000080:1.0:1784938171.641838:0:10390:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd7d176d0 20000000:00000080:1.0:1784938171.641860:0:10390:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910bc7cdb000 uarg=0000000000000000 20000000:01000000:1.0:1784938171.641899:0:10390:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938171.641906:0:10390:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938171.641910:0:10390:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784938171.648535:0:10391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1784938171.649385:0:10390:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1784938171.659057:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1784938171.659096:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1784938171.659111:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1784938171.659126:0:10390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784938171.659145:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.659163:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cd9247600/0x26783cd1c59edfcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edfc6 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.659172:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59edfd4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.659179:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee028 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.659186:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee14e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.659196:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2852f expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.659203:0:10390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.659418:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2852f expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.659481:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2852f expref: 9 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938171.659499:0:10390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144161920:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938171.661582:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee14e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.661613:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee14e expref: 23 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938171.661628:0:10390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144162048:0@lo:104: 00000100:00100000:1.0:1784938171.661687:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784938171.661740:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee028 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.661749:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee028 expref: 23 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938171.661758:0:10390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144162176:0@lo:104: 00000100:00100000:1.0:1784938171.661782:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784938171.661808:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edfd4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.661817:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edfd4 expref: 23 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938171.661826:0:10390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144162304:0@lo:104: 00010000:00010000:1.0:1784938171.661848:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cd9247600/0x26783cd1c59edfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59edfc6 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.661870:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cd9247600/0x26783cd1c59edfcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59edfc6 expref: 23 pid: 6507 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938171.661878:0:10390:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144162432:0@lo:104: 00000100:00100000:1.0:1784938171.661896:0:10390:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938171.662149:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784938171.662169:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938171.662183:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938171.662192:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144162048 00000100:00100000:2.0:1784938171.662199:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144162048 00000100:00100000:2.0:1784938171.662275:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144162176 00000100:00100000:2.0:1784938171.662279:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144162176 00000100:00100000:2.0:1784938171.662289:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144162304 00000100:00100000:2.0:1784938171.662291:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144162304 00000100:00100000:2.0:1784938171.662299:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144162432 00000100:00100000:2.0:1784938171.662301:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144162432 00000100:00100000:2.0:1784938171.662313:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784938171.662321:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+6:10390:x1871643144162048:12345-0@lo:104: 00010000:00010000:2.0:1784938171.662333:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662386:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938171.662391:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+6:10390:x1871643144162048:12345-0@lo:104: Request processed in 72us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.662399:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784938171.662417:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784938171.662435:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+5:10390:x1871643144162176:12345-0@lo:104: 00010000:00010000:2.0:1784938171.662450:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662497:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784938171.662503:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+5:10390:x1871643144162176:12345-0@lo:104: Request processed in 81us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.662510:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784938171.662550:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784938171.662556:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:10390:x1871643144162304:12345-0@lo:104: 00010000:00010000:2.0:1784938171.662563:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662595:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784938171.662673:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:10390:x1871643144162304:12345-0@lo:104: Request processed in 116us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.662681:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784938171.662695:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938171.662701:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:10390:x1871643144162432:12345-0@lo:104: 00010000:00010000:2.0:1784938171.662710:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662738:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784938171.662743:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:10390:x1871643144162432:12345-0@lo:104: Request processed in 43us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.662748:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1784938171.662763:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784938171.662770:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662784:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938171.662788:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662798:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938171.662806:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938171.662812:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938171.662839:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662845:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938171.662867:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662874:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b76c00/0x26783cd1c59ee14e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee155 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662887:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938171.662890:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662896:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ae00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938171.662899:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662916:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938171.662923:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938171.662928:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938171.662943:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662949:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938171.662966:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662973:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d0215ae00/0x26783cd1c59ee028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee02f expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662985:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938171.662988:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.662993:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938171.662996:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663002:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938171.663008:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938171.663018:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938171.663031:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663036:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938171.663042:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663049:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cd9247800/0x26783cd1c59edfd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edfdb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663058:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938171.663061:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663067:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0a00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938171.663070:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663077:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938171.663083:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938171.663089:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938171.663101:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663106:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938171.663119:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663126:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d020d0a00/0x26783cd1c59edfc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59edfcd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663140:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938171.663142:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938171.663144:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938171.663152:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938171.663158:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938171.663170:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd45b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144162560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938171.663203:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938171.663258:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938171.663265:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144162944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938171.663284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938171.663312:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144162688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938171.663333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938171.663350:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938171.663355:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd45ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144162816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938171.663376:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938171.663405:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144162560 00000100:00100000:2.0:1784938171.663410:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144162560 00010000:00010000:2.0:1784938171.663429:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee14e expref: 24 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938171.663451:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144162944 00000100:00100000:2.0:1784938171.663454:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144162944 00010000:00010000:2.0:1784938171.663477:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cd9247600/0x26783cd1c59edfcd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edfc6 expref: 25 pid: 6507 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938171.663498:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144162688 00000100:00100000:2.0:1784938171.663502:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144162688 00010000:00010000:2.0:1784938171.663513:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee028 expref: 26 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938171.663522:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144162816 00000100:00100000:2.0:1784938171.663525:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144162816 00010000:00010000:2.0:1784938171.663533:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edfd4 expref: 27 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938171.663545:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784938171.663552:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+27:3641:x1871643144162560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938171.663562:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938171.663567:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee14e expref: 27 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663576:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee14e expref: 27 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.663591:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938171.664729:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d0215ba00/0x26783cd1c59ee155 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee14e expref: 27 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938171.664747:0:10390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144162048:0@lo:104: 00000100:00100000:1.0:1784938171.664760:0:10390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144162176:0@lo:104: 00000100:00100000:1.0:1784938171.664769:0:10390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144162304:0@lo:104: 00000100:00100000:1.0:1784938171.664777:0:10390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144162432:0@lo:104: 00000100:00100000:2.0:1784938171.665317:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+26:3641:x1871643144162560:12345-0@lo:103:ldlm_bl.0 Request processed in 1762us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.665327:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784938171.665354:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938171.665363:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+25:3641:x1871643144162944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938171.665378:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938171.665385:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cd9247600/0x26783cd1c59edfcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edfc6 expref: 25 pid: 6507 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.665414:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cd9247600/0x26783cd1c59edfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edfc6 expref: 25 pid: 6507 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.665446:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9247600/0x26783cd1c59edfcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edfc6 expref: 25 pid: 6507 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.665460:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938171.665503:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144162944:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.665509:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938171.665522:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784938171.665528:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3642:x1871643144162688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938171.665536:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938171.665541:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee028 expref: 23 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.665548:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee028 expref: 23 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.665558:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee02f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee028 expref: 23 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.665567:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938171.665594:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3642:x1871643144162688:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.665805:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784938171.665820:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784938171.665827:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3642:x1871643144162816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938171.665843:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938171.665848:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59edfd4 expref: 21 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.665857:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59edfd4 expref: 21 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.665867:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d1200/0x26783cd1c59edfdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59edfd4 expref: 21 pid: 6505 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.665875:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938171.665900:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+20:3642:x1871643144162816:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (2523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.665906:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784938171.666144:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd45ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144162816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938171.666154:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144162688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938171.666780:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144162944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938171.666790:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd45b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144162560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938171.671277:0:10390:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1871643144161920:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938171.671325:0:10390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938171.676282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938171.676453:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125225856 00000100:00100000:0.0:1784938171.676472:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125225856 00010000:00010000:0.0:1784938171.676512:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2852f expref: 10 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938171.676573:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:0.0:1784938171.676583:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125225856:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938171.676608:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938171.676614:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2852f expref: 10 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676626:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2852f expref: 10 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676643:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee26d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2852f expref: 10 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676660:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676668:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676684:0:9518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676692:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676699:0:9518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676706:0:9518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676723:0:9518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938171.676728:0:9518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676735:0:9518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676758:0:9518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.676770:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938171.676831:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:2392:x1871643125225856:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 249us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938171.676839:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00010000:00010000:1.0:1784938171.676959:0:10390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.676969:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938171.676976:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee331 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.999371:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938172.063740:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938172.063766:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144163072:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938172.064206:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938172.066648:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144163072 00000100:00100000:0.0:1784938172.066663:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144163072 00000100:00100000:0.0:1784938172.066716:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 71 00000100:00100000:0.0:1784938172.066724:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144163072:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938172.066758:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938172.066838:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144163072:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 114us (2633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938172.066845:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 71 00000100:00100000:2.0:1784938172.067394:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144163072:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938172.859441:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938172.859538:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125225984 00000100:00100000:0.0:1784938172.859547:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125225984 00000100:00100000:0.0:1784938172.859591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00100000:0.0:1784938172.859599:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:6166:x1871643125225984:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938172.859626:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938172.859645:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28575 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.859672:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28575 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.859683:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28575 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.859693:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76600, rc 0) 00000100:00100000:0.0:1784938172.859748:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6166:x1871643125225984:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 149us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938172.859756:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00100000:1.0:1784938172.868316:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938172.878170:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125226112 00000100:00100000:1.0:1784938172.878186:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125226112 00000100:00100000:0.0:1784938172.878484:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:0.0:1784938172.878495:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6166:x1871643125226112:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938172.878661:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6166:x1871643125226112:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 167us (10361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938172.878669:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:3.0:1784938172.886486:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938172.897505:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125226240 00000100:00100000:2.0:1784938172.897521:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125226240 00000100:00100000:1.0:1784938172.907540:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00100000:1.0:1784938172.907554:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6166:x1871643125226240:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938172.907701:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6166:x1871643125226240:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 149us (21219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938172.907710:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00100000:0.0:1784938172.911644:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938172.911721:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125226368 00000100:00100000:3.0:1784938172.911730:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125226368 00000100:00100000:3.0:1784938172.911783:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00100000:3.0:1784938172.911792:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6710:x1871643125226368:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938172.912171:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6710:x1871643125226368:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 379us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938172.912180:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00100000:2.0:1784938172.927707:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938172.928122:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125226496 00000100:00100000:0.0:1784938172.928132:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125226496 00000100:00100000:0.0:1784938172.928190:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 257 00000100:00100000:0.0:1784938172.928199:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6710:x1871643125226496:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938172.928367:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:6710:x1871643125226496:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 168us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938172.928385:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 257 10000000:01000000:1.0:1784938173.024348:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938173.024357:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cece6d800 from 4 10000000:01000000:1.0:1784938173.024361:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938173.024412:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.024425:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.024436:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938173.024471:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938173.024543:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938173.024603:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf858600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938173.024690:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144163200 00000100:00100000:0.0:1784938173.024706:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144163200 00000100:00100000:0.0:1784938173.024915:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784938173.024928:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144163200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938173.024949:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938173.024971:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee33f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.025003:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee33f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.025016:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee33f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.025026:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76000, rc 0) 00000100:00100000:0.0:1784938173.025118:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144163200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.025125:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00010000:2.0:1784938173.026721:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938173.027473:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938173.027517:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.027529:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938173.027620:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.027681:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938173.028420:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd58d240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938173.030354:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144163328 00000100:00100000:1.0:1784938173.030377:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144163328 00000100:00100000:1.0:1784938173.030535:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784938173.030673:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144163328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938173.031015:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144163328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (3331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938173.031025:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784938173.031165:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.031254:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.031342:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938173.031384:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd58d240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938173.031698:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144163456 00000100:00100000:0.0:1784938173.031709:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144163456 00000100:00100000:0.0:1784938173.031759:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784938173.031769:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144163456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.032076:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144163456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 307us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.032083:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1784938173.032438:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.033059:0:10421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10421:1871643144163584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938173.033123:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938173.033159:0:10421:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd58d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938173.033259:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144163584 00000100:00100000:0.0:1784938173.033281:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144163584 00000100:00100000:0.0:1784938173.033341:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784938173.033350:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:10421:x1871643144163584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938173.033521:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:10421:x1871643144163584:12345-0@lo:502:llog_process_th.0 Request processed in 171us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.033531:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1784938173.033569:0:10421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10421:1871643144163584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938173.033603:0:10421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938173.033615:0:10421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938173.033618:0:10421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784938173.033626:0:10421:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cece6d800 00000020:00000080:2.0:1784938173.033629:0:10421:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784938173.033719:0:10421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10421:1871643144163712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938173.033764:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938173.033798:0:10421:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd58d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938173.033904:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144163712 00000100:00100000:0.0:1784938173.033912:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144163712 00000100:00100000:0.0:1784938173.033950:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784938173.033957:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:10421:x1871643144163712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938173.034041:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:10421:x1871643144163712:12345-0@lo:502:llog_process_th.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.034048:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784938173.037033:0:10421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10421:1871643144163712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938173.037082:0:10421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938173.037091:0:10421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938173.037093:0:10421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784938173.037098:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784938173.037284:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784938173.037340:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938173.037357:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.037372:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938173.037385:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784938173.037388:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cfd213000 from 4 10000000:01000000:0.0:1784938173.037392:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938173.037447:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.037466:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.037502:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.037534:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.037645:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938173.037711:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8dadf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938173.038427:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144163840 00000100:00100000:2.0:1784938173.038439:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144163840 00000100:00100000:2.0:1784938173.038510:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784938173.038520:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144163840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938173.038538:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938173.038556:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee34d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.038585:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee34d expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.038594:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee34d expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.038603:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7469c00, rc 0) 00000100:00100000:2.0:1784938173.038675:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144163840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.038684:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784938173.038759:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938173.038797:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.038809:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.038913:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.038967:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938173.039005:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8dadf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938173.041079:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144163968 00000100:00100000:2.0:1784938173.041091:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144163968 00000100:00100000:2.0:1784938173.041143:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784938173.041151:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144163968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.041325:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144163968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.041340:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784938173.041389:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144163968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.041437:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144164096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.041488:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938173.041516:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd58dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938173.041531:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144164096 00000100:00100000:2.0:1784938173.041534:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144164096 00000100:00100000:2.0:1784938173.041558:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784938173.041564:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144164096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.041641:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144164096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.041649:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784938173.041688:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144164096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.041853:0:10423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10423:1871643144164224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938173.041887:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938173.041903:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144164224 00000100:00100000:2.0:1784938173.041906:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144164224 00000100:00100000:2.0:1784938173.041923:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784938173.041928:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:10423:x1871643144164224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938173.044590:0:10423:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd58db40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938173.046190:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:10423:x1871643144164224:12345-0@lo:502:llog_process_th.0 Request processed in 4253us (4294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.046205:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784938173.050592:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938173.050636:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938173.050678:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938173.050705:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938173.050733:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125226752 00000100:00100000:2.0:1784938173.050743:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125226752 00000100:00100000:2.0:1784938173.050798:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125226624 00000100:00100000:2.0:1784938173.050802:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125226624 00000100:00100000:2.0:1784938173.050825:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:2.0:1784938173.050835:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125226752:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938173.050932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125226752:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.050940:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:2.0:1784938173.050958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:3.0:1784938173.051096:0:10423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10423:1871643144164224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938173.051137:0:10423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938173.051147:0:10423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938173.051149:0:10423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784938173.051157:0:10423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cfd213000 00000020:00000080:3.0:1784938173.051159:0:10423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784938173.051327:0:10423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10423:1871643144164352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938173.051404:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938173.051449:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144164352 00000100:00100000:3.0:1784938173.051463:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144164352 00000100:00100000:3.0:1784938173.051495:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784938173.051502:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:10423:x1871643144164352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938173.051602:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:10423:x1871643144164352:12345-0@lo:502:llog_process_th.0 Request processed in 99us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.051610:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784938173.051668:0:10423:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94e79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938173.051681:0:10423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10423:1871643144164352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938173.051700:0:10423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938173.051705:0:10423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938173.051707:0:10423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784938173.051710:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00080000:3.0:1784938173.052331:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938173.052337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938173.052349:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125227008 00000100:00100000:3.0:1784938173.052355:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125227008 00000100:00100000:3.0:1784938173.052402:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125226880 00000100:00100000:3.0:1784938173.052407:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125226880 00000100:00100000:3.0:1784938173.052437:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:3.0:1784938173.052444:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125227008:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938173.052504:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125227008:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 60us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.052511:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:3.0:1784938173.052524:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:3.0:1784938173.052531:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125226880:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938173.052566:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125226880:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.052574:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:2.0:1784938173.053661:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125226624:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:3.0:1784938173.053667:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938173.053673:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938173.053711:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125226624:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 64us (3032us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.053719:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00000020:01000000:1.0:1784938173.055431:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784938173.055485:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938173.055497:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.055510:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938173.055522:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938173.055525:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cc481d800 from 4 10000000:01000000:1.0:1784938173.055528:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938173.055563:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.055572:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.055583:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938173.055608:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144164480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938173.055670:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938173.055719:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938173.055808:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144164480 00000100:00100000:3.0:1784938173.055825:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144164480 00000100:00100000:3.0:1784938173.055895:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784938173.055906:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144164480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938173.055925:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938173.055946:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee35b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.055978:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee35b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.055991:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee35b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.056001:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cd9246c00, rc 0) 00000100:00100000:3.0:1784938173.056081:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144164480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.056087:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784938173.057158:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144164480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938173.057182:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.057195:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938173.057283:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144164608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938173.057356:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938173.057615:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144164608 00000100:00100000:3.0:1784938173.057629:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144164608 00000100:00100000:3.0:1784938173.057699:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784938173.057710:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144164608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.057975:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938173.058638:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144164608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 925us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.058667:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784938173.058932:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144164608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.059149:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144164736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.059427:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938173.059707:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144164736 00000100:00100000:3.0:1784938173.059715:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144164736 00000100:00100000:3.0:1784938173.059765:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784938173.059774:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144164736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938173.059912:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144164736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.059921:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784938173.060066:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8dad6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938173.060157:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144164736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.065368:0:10425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10425:1871643144164864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938173.065472:0:10425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938173.065524:0:10425:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8dad540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938173.071014:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144164864 00000100:00100000:2.0:1784938173.071030:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144164864 00000100:00100000:2.0:1784938173.071097:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1784938173.071111:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:10425:x1871643144164864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938173.071316:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:10425:x1871643144164864:12345-0@lo:502:llog_process_th.0 Request processed in 208us (5842us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.071328:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784938173.071375:0:10425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10425:1871643144164864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938173.071430:0:10425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938173.071443:0:10425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938173.071445:0:10425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784938173.071466:0:10425:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cc481d800 00000020:00000080:3.0:1784938173.071469:0:10425:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784938173.071590:0:10425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10425:1871643144164992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938173.071662:0:10425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938173.071711:0:10425:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94e7780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938173.072089:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144164992 00000100:00100000:2.0:1784938173.072097:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144164992 00000100:00100000:2.0:1784938173.072133:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1784938173.072141:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:10425:x1871643144164992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938173.072274:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:10425:x1871643144164992:12345-0@lo:502:llog_process_th.0 Request processed in 132us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.072282:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784938173.072421:0:10425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb79500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10425:1871643144164992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938173.072465:0:10425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938173.072473:0:10425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938173.072475:0:10425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784938173.072489:0:10425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784938173.072679:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784938173.072712:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938173.072723:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.072734:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938173.072745:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938173.072747:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cca3c9000 from 4 10000000:01000000:2.0:1784938173.072750:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938173.072788:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.072796:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.072806:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938173.072830:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144165120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.072889:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938173.072929:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938173.073699:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144165120 00000100:00100000:3.0:1784938173.073709:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144165120 00000100:00100000:2.0:1784938173.073816:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1784938173.073833:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144165120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938173.073847:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938173.073881:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee369 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.073906:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee369 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.073918:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee369 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.073927:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7469000, rc 0) 00000100:00100000:2.0:1784938173.074113:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144165120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.074121:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1784938173.074253:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144165120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938173.074272:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.074284:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938173.074372:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144165248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938173.074418:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938173.074466:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938173.074534:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144165248 00000100:00100000:2.0:1784938173.074540:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144165248 00000100:00100000:2.0:1784938173.074623:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1784938173.074631:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144165248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938173.074750:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144165248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.074759:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1784938173.075347:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144165248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.075417:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144165376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.075703:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938173.087762:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144165376 00000100:00100000:3.0:1784938173.088422:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144165376 00000100:00100000:0.0:1784938173.088550:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8dad300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938173.089432:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1784938173.089450:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144165376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938173.101530:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144165376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 12079us (25820us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.101543:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1784938173.101642:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144165376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938173.107760:0:10428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10428:1871643144165504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938173.107856:0:10428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938173.108002:0:10428:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938173.108596:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144165504 00000100:00100000:2.0:1784938173.108605:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144165504 00000100:00100000:2.0:1784938173.108648:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1784938173.108658:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:10428:x1871643144165504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938173.108784:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:10428:x1871643144165504:12345-0@lo:502:llog_process_th.0 Request processed in 127us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938173.108793:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784938173.108919:0:10428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10428:1871643144165504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938173.108948:0:10428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938173.108957:0:10428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938173.108971:0:10428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784938173.108980:0:10428:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cca3c9000 00000020:00000080:1.0:1784938173.108982:0:10428:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784938173.109053:0:10428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10428:1871643144165632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938173.109091:0:10428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938173.109118:0:10428:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019c0300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938173.111277:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144165632 00000100:00100000:1.0:1784938173.111289:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144165632 00000100:00100000:1.0:1784938173.111344:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784938173.111352:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:10428:x1871643144165632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938173.111513:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:10428:x1871643144165632:12345-0@lo:502:llog_process_th.0 Request processed in 161us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938173.111521:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784938173.111849:0:10428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:10428:1871643144165632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938173.111883:0:10428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938173.111890:0:10428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938173.111893:0:10428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784938173.111898:0:10428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784938173.112857:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784938173.112894:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938173.112905:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.112917:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.602476:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144165760:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938173.602850:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938173.602895:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144165760 00000100:00100000:0.0:1784938173.602903:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144165760 00000100:00100000:0.0:1784938173.602964:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 72 00000100:00100000:0.0:1784938173.602973:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144165760:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938173.603014:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938173.603062:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144165760:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.603070:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 72 00000100:00100000:0.0:1784938173.603749:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144165760:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:2.0:1784938174.048511:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938175.071460:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938175.137344:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938175.137413:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144165888:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938175.137708:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd45ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144166016:0@lo:400:kworker.0 00000100:00100000:2.0:1784938175.137776:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938175.137821:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144166144:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.138054:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938175.138168:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938175.138246:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144165888 00000100:00100000:2.0:1784938175.138257:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144165888 00000100:00100000:2.0:1784938175.138328:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:2.0:1784938175.138339:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144165888:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938175.138381:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938175.138434:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144165888:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 95us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938175.138453:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00080000:2.0:1784938175.138480:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938175.138596:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144166144 00000100:00100000:2.0:1784938175.138601:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144166144 00000100:00100000:2.0:1784938175.138633:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 74 00000100:00100000:2.0:1784938175.138640:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144166144:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.138692:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144166144:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 52us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938175.138699:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 74 00000100:00100000:0.0:1784938175.138860:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144166400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.139357:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144166144:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.139369:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144166656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.139421:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144167168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.139595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938175.139622:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:3.0:1784938175.139751:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd45b800 x1871643144165888/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938175.139751:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144166528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938175.139773:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144165888:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938175.139791:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144167040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938175.139794:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144166272:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.139817:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144167552:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938175.139818:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144166784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938175.139840:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144167296:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938175.139950:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144166656 00000100:00100000:2.0:1784938175.139951:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938175.139969:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144166656 00000100:00100000:2.0:1784938175.139970:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144167168 00000100:00100000:2.0:1784938175.139972:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144167168 00000100:00100000:3.0:1784938175.140014:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144167296 00000100:00100000:3.0:1784938175.140017:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144167296 00000100:00100000:1.0:1784938175.140512:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144166016 00000100:00100000:1.0:1784938175.140519:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144166016 00000100:00100000:1.0:1784938175.140557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784938175.140568:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144166016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938175.140751:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144166016:12345-0@lo:400:kworker.0 Request processed in 184us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938175.140759:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1784938175.140871:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 75 00000100:00100000:2.0:1784938175.140882:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144166656:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.140935:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144166656:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 56us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938175.140942:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 75 00000100:00100000:2.0:1784938175.140956:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 76 00000100:00100000:2.0:1784938175.140963:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144167168:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.141645:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144167168:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 663us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938175.141656:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 76 00000100:00080000:2.0:1784938175.141695:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938175.141701:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938175.141724:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144167680:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938175.141824:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd45ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144166016:0@lo:400:kworker.0 00000100:00100000:2.0:1784938175.142093:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938175.142145:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938175.142174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938175.142199:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144166528 00000100:00100000:2.0:1784938175.142206:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144166528 00000100:00100000:2.0:1784938175.142279:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 73 00000100:00100000:2.0:1784938175.142288:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144166528:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.142340:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144166528:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 52us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938175.142347:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 73 00000100:00100000:2.0:1784938175.142368:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144167040 00000100:00100000:2.0:1784938175.142371:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144167040 00000100:00100000:2.0:1784938175.142409:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00100000:2.0:1784938175.142415:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144167040:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.142753:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144167040:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938175.142763:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00080000:2.0:1784938175.142784:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938175.142957:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144166656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.142973:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144167168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.143294:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144166528:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938175.143314:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731180 x1871643144167040/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938175.143326:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144167040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.143356:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144167680 00000100:00100000:2.0:1784938175.143361:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144167680 00000100:00100000:2.0:1784938175.143408:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:2.0:1784938175.143417:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144167680:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938175.143449:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938175.143494:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144167680:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 78us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938175.143501:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00080000:2.0:1784938175.143522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938175.143705:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938175.143733:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938175.143764:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:2.0:1784938175.143817:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc489ea00 x1871643144167680/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938175.143834:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144167680:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938175.143858:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144166784 00000100:00100000:2.0:1784938175.143863:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144166784 00000100:00100000:2.0:1784938175.143913:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77 00000100:00100000:2.0:1784938175.143919:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144166784:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.143954:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144166784:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938175.143960:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77 00000100:00080000:2.0:1784938175.143979:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938175.145318:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144167552 00000100:00100000:2.0:1784938175.145336:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144167552 00000100:00100000:2.0:1784938175.145393:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:2.0:1784938175.145402:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144167552:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938175.145829:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 78 00000100:00100000:3.0:1784938175.145842:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144167296:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938175.146372:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144166272 00000100:00100000:1.0:1784938175.146382:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144166272 00000100:00100000:1.0:1784938175.146426:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 74 00000100:00100000:1.0:1784938175.146435:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144166272:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938175.149104:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938175.149145:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144166400 00000100:00100000:0.0:1784938175.149156:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144166400 00000100:00100000:0.0:1784938175.149237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 79 00000100:00100000:0.0:1784938175.149248:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144166400:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938175.149312:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144166400:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938175.149321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 79 00000100:00100000:0.0:1784938175.149463:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144166400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938175.149480:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144166912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938175.149719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938175.149748:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144167424:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938175.149834:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938175.150039:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144166912 00000100:00100000:0.0:1784938175.150045:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144166912 00000100:00100000:0.0:1784938175.150089:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144167424 00000100:00100000:0.0:1784938175.150092:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144167424 00000100:00100000:0.0:1784938175.150112:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:0.0:1784938175.150121:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144166912:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938175.150169:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144166912:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 48us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938175.150177:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:0.0:1784938175.150192:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:0.0:1784938175.150198:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144167424:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938175.150272:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144167424:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 74us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938175.150279:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 33 00010000:00080000:0.0:1784938175.150401:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd733b80 x1871643144166912/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938175.150414:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144166912:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938175.150426:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587c380 x1871643144167424/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938175.150436:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144167424:192.168.203.126@tcp:400:kworker.0 00000100:00080000:0.0:1784938175.150658:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938175.150708:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731880 x1871643144166784/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938175.150719:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144166784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938175.151026:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144167296:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 5186us (11072us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938175.151037:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 78 00010000:00080000:0.0:1784938175.151386:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587dc00 x1871643144167296/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938175.151398:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144167296:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938175.151718:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144167552:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 6313us (7979us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938175.151729:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 31 00010000:00080000:2.0:1784938175.151977:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587d180 x1871643144167552/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938175.151988:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144167552:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938175.154309:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144166272:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 7570us (10297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938175.154327:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 74 00000100:00100000:1.0:1784938175.155054:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144166272:192.168.203.126@tcp:400:kworker.0 00010000:00010000:2.0:1784938176.096870:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938176.197601:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144167808:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938176.199948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938176.200019:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144167936:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938176.200995:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938176.201036:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144167808 00000100:00100000:0.0:1784938176.201442:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144167808 00000100:00100000:0.0:1784938176.201495:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144167936 00000100:00100000:0.0:1784938176.201498:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144167936 00000100:00100000:0.0:1784938176.201518:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00100000:0.0:1784938176.201529:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144167808:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938176.201804:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938176.202452:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144167808:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 921us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938176.202462:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00100000:0.0:1784938176.202493:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 35 00000100:00100000:0.0:1784938176.202502:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144167936:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938176.202517:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938176.202538:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144167936:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 39us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938176.202544:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 35 00010000:00080000:0.0:1784938176.205451:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7cc8a80 x1871643144167808/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938176.205486:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144167808:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00080000:3.0:1784938176.205752:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb79500 x1871643144167936/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938176.205769:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144167936:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00010000:2.0:1784938177.121522:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938177.185884:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938177.185909:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144168064:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938177.186191:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938177.186246:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144168064 00000100:00100000:3.0:1784938177.186262:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144168064 00000100:00100000:3.0:1784938177.186309:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 75 00000100:00100000:3.0:1784938177.186317:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144168064:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938177.186352:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784938177.186396:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144168064:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938177.186402:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 75 00000100:00100000:3.0:1784938177.186526:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144168064:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:3.0:1784938178.143807:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938178.167891:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938178.167942:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938178.167997:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938178.168016:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938178.168044:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938178.168069:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125227264 00000100:00100000:1.0:1784938178.168077:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125227264 00000100:00100000:1.0:1784938178.168132:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125227392 00000100:00100000:1.0:1784938178.168135:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125227392 00000100:00100000:1.0:1784938178.168160:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:1.0:1784938178.168170:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125227264:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938178.168281:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125227264:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 112us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938178.168289:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:1.0:1784938178.168319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:1.0:1784938178.168326:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125227392:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938178.168351:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125227392:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938178.168357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:1.0:1784938178.168376:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125227520 00000100:00100000:1.0:1784938178.168379:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125227520 00000100:00100000:1.0:1784938178.168404:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125227648 00000100:00100000:1.0:1784938178.168408:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125227648 00000100:00100000:1.0:1784938178.168436:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1784938178.168443:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125227520:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938178.168470:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125227520:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938178.168475:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1784938178.168631:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:1.0:1784938178.168638:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125227648:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938178.168661:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125227648:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938178.168666:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00080000:1.0:1784938178.168681:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938178.168685:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938178.168686:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938178.168689:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938178.169117:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125227136 00000100:00100000:2.0:1784938178.169124:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125227136 00000100:00100000:2.0:1784938178.169167:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00100000:2.0:1784938178.169183:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125227136:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938178.169244:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125227136:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 70us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938178.169251:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00100000:2.0:1784938178.733595:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938178.733621:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144168192:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938178.734520:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938178.734549:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144168192 00000100:00100000:1.0:1784938178.734555:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144168192 00000100:00100000:1.0:1784938178.734600:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 76 00000100:00100000:1.0:1784938178.734609:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144168192:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938178.734665:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938178.734710:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144168192:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 101us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938178.734717:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 76 00000100:00100000:1.0:1784938178.734844:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144168192:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:3.0:1784938179.177029:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938180.138000:0:10690:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1784938180.191343:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938180.255542:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144168320:0@lo:400:kworker.0 00000100:00100000:2.0:1784938180.255612:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938180.255655:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144168832:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938180.255705:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144169344:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938180.255733:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144169856:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938180.255763:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784938180.255770:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144168448:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938180.255794:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144168960:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938180.255814:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144169472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.256163:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144168576:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.256197:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144169088:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.256248:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144169600:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.256271:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784938180.256277:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144168704:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.256313:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144169216:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.256344:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144169728:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.256380:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144168320 00000100:00100000:1.0:1784938180.256386:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144168320 00000100:00100000:1.0:1784938180.256443:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784938180.256452:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144168320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938180.256500:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144168320:12345-0@lo:400:kworker.0 Request processed in 49us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.256508:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784938180.256734:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256798:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256820:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256840:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256872:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256892:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256927:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256941:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256953:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256967:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.256982:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938180.257010:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144168832 00000100:00100000:1.0:1784938180.257013:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144168832 00000100:00100000:1.0:1784938180.257035:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144168576 00000100:00100000:1.0:1784938180.257037:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144168576 00000100:00100000:1.0:1784938180.257050:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77 00000100:00100000:1.0:1784938180.257064:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144168832:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257100:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144168832:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257106:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77 00000100:00100000:1.0:1784938180.257118:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 78 00000100:00100000:1.0:1784938180.257123:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144168576:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257148:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144168576:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257154:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 78 00000100:00100000:1.0:1784938180.257169:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144169344 00000100:00100000:1.0:1784938180.257172:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144169344 00000100:00100000:1.0:1784938180.257196:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144169856 00000100:00100000:1.0:1784938180.257199:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144169856 00000100:00100000:1.0:1784938180.257208:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144169216 00000100:00100000:1.0:1784938180.257210:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144169216 00000100:00100000:1.0:1784938180.257243:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144169728 00000100:00100000:1.0:1784938180.257245:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144169728 00000100:00100000:1.0:1784938180.257257:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:1.0:1784938180.257263:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144169344:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257286:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144169344:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257293:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:1.0:1784938180.257304:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:1.0:1784938180.257310:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144169856:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257330:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144169856:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257345:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:1.0:1784938180.257356:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:1.0:1784938180.257362:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144169216:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257383:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144169216:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257389:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:1.0:1784938180.257398:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:1.0:1784938180.257404:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144169728:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257436:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144169728:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257441:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:1.0:1784938180.257459:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144168448 00000100:00100000:1.0:1784938180.257463:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144168448 00000100:00100000:1.0:1784938180.257478:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144168960 00000100:00100000:1.0:1784938180.257481:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144168960 00000100:00100000:1.0:1784938180.257491:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144169472 00000100:00100000:1.0:1784938180.257493:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144169472 00000100:00100000:1.0:1784938180.257503:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144169088 00000100:00100000:1.0:1784938180.257505:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144169088 00000100:00100000:1.0:1784938180.257516:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144168704 00000100:00100000:1.0:1784938180.257518:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144168704 00000100:00100000:1.0:1784938180.257527:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144169600 00000100:00100000:1.0:1784938180.257530:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144169600 00000100:00100000:1.0:1784938180.257542:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00100000:1.0:1784938180.257547:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144168448:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257569:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144168448:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00100000:1.0:1784938180.257594:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 83 00000100:00100000:1.0:1784938180.257600:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144168960:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257625:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144168960:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257631:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 83 00000100:00100000:1.0:1784938180.257642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:1.0:1784938180.257647:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144169472:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257667:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144169472:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257673:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:1.0:1784938180.257683:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00100000:1.0:1784938180.257690:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144169088:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257707:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144169088:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257712:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00100000:1.0:1784938180.257722:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 86 00000100:00100000:1.0:1784938180.257727:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144168704:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257742:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144168704:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257748:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 86 00000100:00100000:1.0:1784938180.257757:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 87 00000100:00100000:1.0:1784938180.257763:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144169600:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.257787:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144169600:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938180.257793:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 87 00000100:00080000:1.0:1784938180.257823:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938180.257827:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938180.257830:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938180.257832:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938180.258097:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144168704:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938180.258111:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678ca80 x1871643144169216/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938180.258121:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144169216:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938180.258130:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c6d80 x1871643144169728/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938180.258138:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144169728:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938180.258148:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144168576:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938180.258157:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678e680 x1871643144169088/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938180.258165:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144169088:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938180.258176:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678d500 x1871643144169600/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938180.258183:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144169600:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938180.258539:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144168448:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938180.258551:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144168960:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938180.258562:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144169472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938180.258572:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144168320:0@lo:400:kworker.0 00000100:00100000:3.0:1784938180.258581:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144168832:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938180.258592:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678d180 x1871643144169344/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938180.258601:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144169344:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938180.258611:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c5880 x1871643144169856/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938180.258618:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144169856:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938180.258650:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938180.258660:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144169984:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938180.258783:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938180.258804:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144169984 00000100:00100000:3.0:1784938180.258809:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144169984 00000100:00100000:3.0:1784938180.258843:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:3.0:1784938180.258860:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144169984:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938180.258884:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938180.258918:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144169984:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 67us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938180.258925:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 36 00010000:00080000:3.0:1784938180.259011:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb14000 x1871643144169984/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938180.259026:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144169984:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938180.265959:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938180.265992:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144170112:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938180.267114:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938180.268580:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144170112 00000100:00100000:2.0:1784938180.268595:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144170112 00000100:00100000:2.0:1784938180.268654:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:2.0:1784938180.268664:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144170112:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938180.268689:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938180.268754:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144170112:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 91us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938180.268761:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 37 00010000:00080000:2.0:1784938180.268950:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7dd880 x1871643144170112/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938180.268988:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144170112:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00010000:2.0:1784938181.225989:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938181.281546:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144170240:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938181.281922:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938181.281987:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144170240 00000100:00100000:2.0:1784938181.281995:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144170240 00000100:00100000:2.0:1784938181.282052:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:2.0:1784938181.282061:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144170240:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938181.282094:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938181.282136:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144170240:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938181.282143:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 38 00010000:00080000:2.0:1784938181.282292:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7cc8a80 x1871643144170240/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938181.282309:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144170240:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938181.294155:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144170368:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938181.294567:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938181.294597:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144170368 00000100:00100000:2.0:1784938181.294603:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144170368 00000100:00100000:2.0:1784938181.298519:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:2.0:1784938181.298597:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144170368:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938181.298637:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938181.298712:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144170368:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 124us (4145us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938181.303797:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 39 00010000:00080000:3.0:1784938181.314105:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c5f80 x1871643144170368/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938181.314131:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144170368:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00010000:3.0:1784938182.244253:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938182.303766:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144170496:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938182.304684:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938182.305014:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144170496 00000100:00100000:2.0:1784938182.305022:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144170496 00000100:00100000:2.0:1784938182.305076:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 79 00000100:00100000:2.0:1784938182.305085:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144170496:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938182.305120:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784938182.305176:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144170496:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 92us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938182.305183:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 79 00000100:00100000:2.0:1784938182.305763:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144170496:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:2.0:1784938183.263377:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938183.300164:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938183.300190:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938183.300209:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938183.300250:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938183.300875:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938183.301363:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125228160 00000100:00100000:1.0:1784938183.301374:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125228160 00000100:00100000:1.0:1784938183.301442:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125228288 00000100:00100000:1.0:1784938183.301445:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125228288 00000100:00100000:1.0:1784938183.301471:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1784938183.301479:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2391:x1871643125228160:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:1.0:1784938183.301514:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee289 00000100:00080000:1.0:1784938183.301523:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910bc58d3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938183.301565:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1784938183.302491:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125227904 00000100:00100000:3.0:1784938183.302506:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125227904 00000100:00100000:3.0:1784938183.302543:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125228032 00000100:00100000:3.0:1784938183.302545:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125228032 00000100:00100000:3.0:1784938183.302569:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:3.0:1784938183.302577:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125227904:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938183.303522:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125227904:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 942us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938183.303531:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:3.0:1784938183.303553:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:3.0:1784938183.303560:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125228032:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938183.303985:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+2:2391:x1871643125228160:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 2503us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938183.303994:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1784938183.304009:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:1.0:1784938183.304016:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2391:x1871643125228288:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:1.0:1784938183.304036:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee282 00000100:00080000:1.0:1784938183.304046:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910bc7c63000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938183.304085:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1784938183.304166:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+2:2391:x1871643125228288:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 150us (3974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938183.304172:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00080000:1.0:1784938183.304189:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938183.304194:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938183.304207:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938183.304209:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784938183.304304:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938183.304312:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938183.312170:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125228032:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 8348us (11035us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938183.312187:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:3.0:1784938183.312258:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125227776 00000100:00100000:3.0:1784938183.312267:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125227776 00000100:00100000:3.0:1784938183.312440:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 281 00000100:00100000:3.0:1784938183.312449:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2394:x1871643125227776:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938183.312500:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2394:x1871643125227776:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 52us (12249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938183.312507:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 281 00000100:00100000:1.0:1784938183.840149:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144170624:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938183.840436:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938183.840464:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144170624 00000100:00100000:1.0:1784938183.840472:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144170624 00000100:00100000:1.0:1784938183.840519:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 80 00000100:00100000:1.0:1784938183.840528:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144170624:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938183.840563:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938183.840611:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144170624:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 84us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938183.840620:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 80 00000100:00100000:3.0:1784938183.842034:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144170624:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:2.0:1784938184.288018:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938185.321159:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938185.375864:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938185.375890:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144170752:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938185.376575:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938185.377411:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144171008:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.377476:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144170880:0@lo:400:kworker.0 00000100:00100000:2.0:1784938185.377519:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938185.377587:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144170880 00000100:00100000:2.0:1784938185.377593:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144170880 00000100:00100000:2.0:1784938185.377639:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1784938185.377648:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3643:x1871643144170880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938185.377696:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3643:x1871643144170880:12345-0@lo:400:kworker.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.377703:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1784938185.377748:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144170880:0@lo:400:kworker.0 00000100:00100000:0.0:1784938185.381068:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938185.381166:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938185.381197:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144170752 00000100:00100000:0.0:1784938185.381233:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144170752 00000100:00100000:0.0:1784938185.381288:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:0.0:1784938185.381298:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144170752:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938185.381327:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938185.381393:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144170752:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 97us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938185.381401:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:0.0:1784938185.381423:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144171008 00000100:00100000:0.0:1784938185.381426:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144171008 00000100:00100000:0.0:1784938185.381449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 90 00000100:00100000:0.0:1784938185.381454:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144171008:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938185.381481:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144171008:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938185.381488:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 90 00000100:00080000:0.0:1784938185.381501:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938185.381630:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144171008:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938185.382671:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938185.382693:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144171136:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938185.382862:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938185.382885:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144171136 00000100:00100000:0.0:1784938185.382891:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144171136 00000100:00100000:0.0:1784938185.382950:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:0.0:1784938185.382959:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144171136:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938185.382977:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938185.383010:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144171136:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938185.383027:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00080000:0.0:1784938185.383103:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784938185.383130:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7cc8700 x1871643144171136/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938185.383149:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144171136:192.168.203.126@tcp:13:osp-pre-1-0.0 00010000:00080000:2.0:1784938185.387507:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c4380 x1871643144170752/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938185.387535:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144170752:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938185.389508:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144171648:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.389605:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144172160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.389633:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784938185.389639:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144171264:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.389661:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144171776:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.389680:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144172288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.389709:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144171520:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.389731:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144172032:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.389759:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784938185.389764:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144171392:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.389785:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144171904:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.389954:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938185.390015:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938185.390077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938185.390094:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938185.390110:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938185.390142:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938185.390171:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938185.390185:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938185.390201:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938185.390241:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144172032 00000100:00100000:2.0:1784938185.390248:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144172032 00000100:00100000:2.0:1784938185.390293:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144171904 00000100:00100000:2.0:1784938185.390296:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144171904 00000100:00100000:2.0:1784938185.390319:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:2.0:1784938185.390327:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144172032:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.390370:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144172032:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 44us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.390389:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:2.0:1784938185.390406:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:2.0:1784938185.390412:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144171904:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.390433:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144171904:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.390438:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:2.0:1784938185.390455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144171648 00000100:00100000:2.0:1784938185.390459:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144171648 00000100:00100000:2.0:1784938185.390473:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144172160 00000100:00100000:2.0:1784938185.390475:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144172160 00000100:00100000:2.0:1784938185.390483:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144171776 00000100:00100000:2.0:1784938185.390485:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144171776 00000100:00100000:2.0:1784938185.390493:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144172288 00000100:00100000:2.0:1784938185.390496:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144172288 00000100:00100000:2.0:1784938185.390504:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144171392 00000100:00100000:2.0:1784938185.390505:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144171392 00000100:00100000:2.0:1784938185.390516:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 91 00000100:00100000:2.0:1784938185.390520:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144171648:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.390546:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144171648:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.390552:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 91 00000100:00100000:2.0:1784938185.390562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 92 00000100:00100000:2.0:1784938185.390567:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144172160:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.390582:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144172160:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 15us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.390586:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 92 00000100:00100000:2.0:1784938185.390594:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 93 00000100:00100000:2.0:1784938185.390598:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144171776:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.390613:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144171776:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 15us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.390617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 93 00000100:00100000:2.0:1784938185.390626:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 94 00000100:00100000:2.0:1784938185.390631:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144172288:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.390646:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144172288:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 15us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.390650:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 94 00000100:00100000:2.0:1784938185.390659:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 95 00000100:00100000:2.0:1784938185.390663:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144171392:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.390676:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144171392:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 14us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.390681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 95 00000100:00100000:2.0:1784938185.390707:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144171264 00000100:00100000:2.0:1784938185.390711:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144171264 00000100:00100000:2.0:1784938185.390732:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144171520 00000100:00100000:2.0:1784938185.390735:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144171520 00000100:00100000:2.0:1784938185.390747:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 81 00000100:00100000:2.0:1784938185.390753:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144171264:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.390777:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144171264:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.390783:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 81 00000100:00100000:2.0:1784938185.390794:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00100000:2.0:1784938185.390799:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144171520:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.390816:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144171520:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 17us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.390822:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00080000:2.0:1784938185.390841:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938185.390845:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938185.390847:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938185.391103:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144171264:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938185.391118:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587c380 x1871643144171776/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938185.391128:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144171776:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938185.391139:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb76680 x1871643144172288/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938185.391147:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144172288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.391168:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144171648:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.391177:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144172160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.391232:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144171392:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938185.391246:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587d880 x1871643144171904/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938185.391256:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144171904:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938185.391265:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144171520:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938185.391275:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587ed80 x1871643144172032/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938185.391283:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144172032:192.168.203.126@tcp:400:kworker.0 00010000:00010000:1.0:1784938186.343845:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938186.399929:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938186.399957:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144172416:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938186.400276:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938186.400306:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144172416 00000100:00100000:3.0:1784938186.400313:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144172416 00000100:00100000:3.0:1784938186.400358:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:3.0:1784938186.400378:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144172416:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938186.400421:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938186.400460:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144172416:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 94us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938186.400467:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 42 00010000:00080000:1.0:1784938186.400658:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb78a80 x1871643144172416/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938186.400677:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144172416:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938186.407520:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144172544:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938186.407803:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938186.407834:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144172544 00000100:00100000:0.0:1784938186.407840:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144172544 00000100:00100000:0.0:1784938186.407883:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:0.0:1784938186.407892:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144172544:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938186.407915:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938186.407955:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144172544:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 65us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938186.407964:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 43 00010000:00080000:0.0:1784938186.408073:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7cc8700 x1871643144172544/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938186.408092:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144172544:192.168.203.126@tcp:13:osp-pre-0-0.0 00000001:02000400:0.0:1784938186.844189:0:10934:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing yml_node 00010000:00010000:2.0:1784938187.359336:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938187.433706:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938187.433733:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144172672:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938187.434021:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938187.434148:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144172672 00000100:00100000:3.0:1784938187.434156:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144172672 00000100:00100000:3.0:1784938187.434232:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 83 00000100:00100000:3.0:1784938187.434243:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144172672:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938187.441103:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784938187.441191:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144172672:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 6946us (7167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938187.441200:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 83 00000100:00100000:1.0:1784938187.441898:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144172672:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938188.405920:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938188.416851:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938188.416887:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938188.416913:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938188.416938:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125228672 00000100:00100000:3.0:1784938188.416946:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125228672 00000100:00100000:3.0:1784938188.416998:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125228544 00000100:00100000:3.0:1784938188.417001:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125228544 00000100:00100000:3.0:1784938188.417023:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:3.0:1784938188.417031:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125228672:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938188.417092:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125228672:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 63us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938188.417099:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:3.0:1784938188.417114:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:3.0:1784938188.417119:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125228544:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938188.417137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125228544:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 19us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938188.417155:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00080000:3.0:1784938188.417174:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938188.417178:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938188.417245:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125228416 00000100:00100000:1.0:1784938188.417249:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125228416 00000100:00100000:1.0:1784938188.417281:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 283 00000100:00100000:1.0:1784938188.417287:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125228416:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938188.417312:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125228416:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938188.417318:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 283 00000100:00100000:2.0:1784938188.960165:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144172800:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938188.960820:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938188.960987:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144172800 00000100:00100000:2.0:1784938188.960996:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144172800 00000100:00100000:2.0:1784938188.961047:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:2.0:1784938188.961055:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144172800:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:2.0:1784938188.961089:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784938188.961149:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144172800:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938188.961157:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:2.0:1784938188.961647:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144172800:192.168.203.126@tcp:41:osp-pre-1-0.0 00000001:00100000:1.0:1784938188.962682:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:1.0:1784938188.962690:0:8424:0:(genops.c:906:class_export_put()) final put ffff910bc58d0800/263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:2.0:1784938188.962763:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc58d0800/263deb07-6496-49f7-9596-7a44f1bd8c2b for lustre-OST0000 00000020:00000080:2.0:1784938188.962822:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc58d3800 for lustre-OST0000 00000001:00100000:0.0:1784938188.963117:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:0.0:1784938188.963122:0:9509:0:(genops.c:906:class_export_put()) final put ffff910bc7c61000/263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:3.0:1784938188.963187:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7c61000/263deb07-6496-49f7-9596-7a44f1bd8c2b for lustre-OST0001 00000020:00000080:3.0:1784938188.963254:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc7c63000 for lustre-OST0001 00010000:00010000:1.0:1784938189.407457:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938190.431380:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938190.496024:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938190.496049:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144172928:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938190.496377:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938190.496621:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144172928 00000100:00100000:1.0:1784938190.496629:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144172928 00000100:00100000:1.0:1784938190.496692:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:1.0:1784938190.496701:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144172928:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938190.496731:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938190.496785:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144172928:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 85us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938190.496793:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 44 00010000:00080000:1.0:1784938190.496930:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7cc8700 x1871643144172928/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938190.496949:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144172928:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00080000:3.0:1784938190.497105:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938190.502406:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144173312:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.502500:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144173824:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.502527:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144174336:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.502554:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784938190.502560:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144173184:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.502584:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144173696:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.502608:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144174208:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938190.502979:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.503058:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.503074:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.503089:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.503105:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.503140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938190.503361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144173824 00000100:00100000:3.0:1784938190.503368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144173824 00000100:00100000:3.0:1784938190.503421:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144174336 00000100:00100000:3.0:1784938190.503424:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144174336 00000100:00100000:3.0:1784938190.503437:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144173184 00000100:00100000:3.0:1784938190.503440:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144173184 00000100:00100000:3.0:1784938190.503449:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144173696 00000100:00100000:3.0:1784938190.503450:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144173696 00000100:00100000:3.0:1784938190.503461:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144174208 00000100:00100000:3.0:1784938190.503463:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144174208 00000100:00100000:3.0:1784938190.503477:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 98 00000100:00100000:3.0:1784938190.503486:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144173824:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503534:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144173824:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 49us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938190.503542:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 98 00000100:00100000:3.0:1784938190.503558:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 99 00000100:00100000:3.0:1784938190.503564:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144174336:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503587:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144174336:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938190.503593:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 99 00000100:00100000:3.0:1784938190.503612:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 100 00000100:00100000:3.0:1784938190.503618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144173184:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503642:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144173184:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938190.503647:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 100 00000100:00100000:3.0:1784938190.503659:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 101 00000100:00100000:3.0:1784938190.503664:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144173696:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503692:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144173696:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938190.503697:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 101 00000100:00100000:3.0:1784938190.503708:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 102 00000100:00100000:3.0:1784938190.503714:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144174208:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503734:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144174208:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938190.503740:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 102 00000100:00100000:3.0:1784938190.503770:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144173440:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503801:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144173952:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503829:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144174464:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503856:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1784938190.503863:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144173056:0@lo:400:kworker.0 00000100:00100000:3.0:1784938190.503894:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938190.503915:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144173568:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503944:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144174080:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.503961:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144174592:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938190.504288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144173312 00000100:00100000:2.0:1784938190.504293:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144173312 00000100:00100000:2.0:1784938190.504345:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00100000:2.0:1784938190.504353:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144173312:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.504379:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144173312:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938190.504384:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00100000:2.0:1784938190.504403:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144173056 00000100:00100000:2.0:1784938190.504413:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144173056 00000100:00100000:2.0:1784938190.504438:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784938190.504443:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144173056:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784938190.509597:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938190.509607:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938190.509994:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.510028:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.510048:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.510065:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.510086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.510106:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938190.510143:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144173952 00000100:00100000:0.0:1784938190.510151:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144173952 00000100:00100000:0.0:1784938190.510199:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144174080 00000100:00100000:0.0:1784938190.510202:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144174080 00000100:00100000:2.0:1784938190.510568:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144174464 00000100:00100000:2.0:1784938190.510573:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144174464 00000100:00100000:1.0:1784938190.510682:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144174592 00000100:00100000:1.0:1784938190.510687:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144174592 00000100:00100000:1.0:1784938190.510716:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:1.0:1784938190.510739:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144174592:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938190.510759:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938190.510814:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144174592:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 77us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938190.510820:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 45 00010000:00080000:1.0:1784938190.510966:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7cc9880 x1871643144174592/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938190.510987:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144174592:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938190.511395:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144173568 00000100:00100000:3.0:1784938190.511401:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144173568 00000100:00100000:3.0:1784938190.511449:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 86 00000100:00100000:3.0:1784938190.511457:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144173568:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.511497:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144173568:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 41us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938190.511503:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 86 00000100:00100000:3.0:1784938190.511652:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144173056:12345-0@lo:400:kworker.0 Request processed in 7208us (7756us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938190.511661:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1784938190.511960:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144173440 00000100:00100000:3.0:1784938190.511965:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144173440 00000100:00100000:3.0:1784938190.511993:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 103 00000100:00100000:3.0:1784938190.511999:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144173440:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.512032:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144173440:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938190.512038:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 103 00000100:00100000:3.0:1784938190.512144:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144173184:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.512159:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144173696:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.512171:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144174208:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938190.512182:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144173312:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938190.512209:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d80700 x1871643144173824/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938190.512745:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144173824:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938190.512765:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d83800 x1871643144174336/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938190.512775:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144174336:192.168.203.126@tcp:400:kworker.0 00000100:00080000:3.0:1784938190.512829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938190.512834:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938190.518867:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:2.0:1784938190.518893:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144173952:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.518987:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144173952:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 106us (8997us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938190.518996:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:2.0:1784938190.519019:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:2.0:1784938190.519026:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144174080:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.519050:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144174080:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (9001us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938190.519056:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:2.0:1784938190.519067:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:2.0:1784938190.519074:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144174464:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.519100:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144174464:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (9033us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938190.519106:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:2.0:1784938190.519408:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144173056:0@lo:400:kworker.0 00000100:00100000:2.0:1784938190.519438:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144173568:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938190.519452:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d81180 x1871643144174080/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938190.519482:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144174080:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938190.519497:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144173440:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938190.519508:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d82300 x1871643144173952/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938190.519515:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144173952:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938190.519526:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d82d80 x1871643144174464/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938190.519532:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144174464:192.168.203.126@tcp:400:kworker.0 00010000:00010000:1.0:1784938191.455686:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938191.519499:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144174720:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938191.522194:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938191.522245:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144174720 00000100:00100000:1.0:1784938191.522252:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144174720 00000100:00100000:1.0:1784938191.522302:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:1.0:1784938191.522311:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144174720:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938191.522352:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938191.522406:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144174720:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938191.522414:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:3.0:1784938191.522552:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938191.522564:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144174848:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938191.522917:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938191.522938:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144174848 00000100:00100000:2.0:1784938191.522942:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144174848 00000100:00100000:2.0:1784938191.522967:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:2.0:1784938191.522974:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144174848:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938191.522986:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938191.523012:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144174848:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 37us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938191.523018:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 47 00010000:00080000:3.0:1784938191.523292:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb78700 x1871643144174848/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938191.523311:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144174848:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00080000:3.0:1784938191.523323:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd733b80 x1871643144174720/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938191.523345:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144174720:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938192.480063:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938192.546575:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144174976:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938192.547591:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938192.547629:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144174976 00000100:00100000:3.0:1784938192.547638:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144174976 00000100:00100000:3.0:1784938192.547695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 87 00000100:00100000:3.0:1784938192.547705:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144174976:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938192.547779:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784938192.547840:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144174976:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938192.547848:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 87 00000100:00100000:0.0:1784938192.548927:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144174976:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:3.0:1784938193.504402:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938193.527252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938193.527286:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938193.527303:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938193.527335:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125228928 00000100:00100000:3.0:1784938193.527343:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125228928 00000100:00100000:3.0:1784938193.527388:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125229056 00000100:00100000:3.0:1784938193.527390:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125229056 00000100:00100000:3.0:1784938193.527407:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:3.0:1784938193.527414:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125228928:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938193.527473:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125228928:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 60us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938193.527479:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:3.0:1784938193.527493:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:3.0:1784938193.527499:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125229056:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938193.527515:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125229056:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 17us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938193.527520:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:3.0:1784938193.527534:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125228800 00000100:00100000:3.0:1784938193.527536:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125228800 00000100:00100000:3.0:1784938193.527568:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 285 00000100:00100000:3.0:1784938193.527573:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2393:x1871643125228800:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938193.527604:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2393:x1871643125228800:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938193.527609:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 285 00000100:00080000:3.0:1784938193.527632:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938193.527636:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1784938193.992557:0:11118:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.203 00000100:00100000:2.0:1784938194.079508:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144175104:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938194.081742:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938194.095388:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144175104 00000100:00100000:3.0:1784938194.095402:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144175104 00000100:00100000:3.0:1784938194.095514:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 88 00000100:00100000:3.0:1784938194.095527:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144175104:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938194.100447:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784938194.100540:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144175104:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 5012us (18800us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938194.100551:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 88 00000100:00100000:3.0:1784938194.100781:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144175104:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:3.0:1784938194.527749:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938195.553119:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938195.617899:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144175360:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938195.618050:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938195.618073:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144175232:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938195.618393:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938195.618502:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938195.618538:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144175360 00000100:00100000:0.0:1784938195.618546:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144175360 00000100:00100000:0.0:1784938195.618592:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144175232 00000100:00100000:0.0:1784938195.618595:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144175232 00000100:00100000:0.0:1784938195.618612:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:0.0:1784938195.618620:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144175360:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938195.618648:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938195.618699:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144175360:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938195.618706:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:0.0:1784938195.618724:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:0.0:1784938195.618731:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144175232:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938195.618740:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938195.618760:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144175232:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938195.618766:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00080000:0.0:1784938195.618785:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784938195.618903:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb76d80 x1871643144175232/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938195.618924:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144175232:192.168.203.126@tcp:13:osp-pre-1-0.0 00010000:00080000:0.0:1784938195.618937:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd733b80 x1871643144175360/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938195.618947:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144175360:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938195.620973:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144175744:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938195.621050:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144176256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938195.621073:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144176768:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938195.621116:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784938195.621122:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144175872:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938195.621157:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144176384:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938195.622158:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938195.622186:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938195.622204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938195.622253:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938195.622271:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938195.622295:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144176384 00000100:00100000:2.0:1784938195.622302:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144176384 00000100:00100000:2.0:1784938195.622368:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:2.0:1784938195.622377:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144176384:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938195.622700:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144176384:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 322us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938195.622708:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:3.0:1784938195.623045:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144175488:0@lo:400:kworker.0 00000100:00100000:3.0:1784938195.623100:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938195.623154:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144176000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.623192:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144176512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.623245:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784938195.623253:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144175616:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.623279:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144176128:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.623299:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144176640:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.623368:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144175744 00000100:00100000:3.0:1784938195.623373:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144175744 00000100:00100000:3.0:1784938195.623405:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 89 00000100:00100000:3.0:1784938195.623412:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144175744:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.623456:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144175744:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 44us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.623463:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 89 00000100:00100000:3.0:1784938195.623483:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144176256 00000100:00100000:3.0:1784938195.623499:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144176256 00000100:00100000:3.0:1784938195.623526:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144176768 00000100:00100000:3.0:1784938195.623529:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144176768 00000100:00100000:3.0:1784938195.623541:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144175872 00000100:00100000:3.0:1784938195.623543:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144175872 00000100:00100000:3.0:1784938195.623556:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 106 00000100:00100000:3.0:1784938195.623561:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144176256:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.623587:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144176256:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.623593:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 106 00000100:00100000:3.0:1784938195.623604:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 107 00000100:00100000:3.0:1784938195.623610:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144176768:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.623631:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144176768:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.623637:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 107 00000100:00100000:3.0:1784938195.623648:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 108 00000100:00100000:3.0:1784938195.623654:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144175872:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.623686:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144175872:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.623692:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 108 00000100:00100000:3.0:1784938195.623888:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938195.623907:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938195.623929:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938195.623946:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938195.623975:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938195.624006:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144176000 00000100:00100000:3.0:1784938195.624009:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144176000 00000100:00100000:3.0:1784938195.624029:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 90 00000100:00100000:3.0:1784938195.624034:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144176000:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.624059:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144176000:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.624065:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 90 00000100:00100000:3.0:1784938195.624078:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144175616 00000100:00100000:3.0:1784938195.624081:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144175616 00000100:00100000:3.0:1784938195.624094:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144176128 00000100:00100000:3.0:1784938195.624096:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144176128 00000100:00100000:3.0:1784938195.624105:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144176640 00000100:00100000:3.0:1784938195.624107:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144176640 00000100:00100000:3.0:1784938195.624117:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 109 00000100:00100000:3.0:1784938195.624122:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144175616:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.624140:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144175616:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.624145:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 109 00000100:00100000:3.0:1784938195.624163:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 110 00000100:00100000:3.0:1784938195.624169:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144176128:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.624191:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144176128:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.624197:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 110 00000100:00100000:3.0:1784938195.624207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 111 00000100:00100000:3.0:1784938195.624238:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144176640:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.624261:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144176640:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 48us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.624267:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 111 00000100:00100000:3.0:1784938195.624418:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144175616:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.624429:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144176128:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.624438:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144176640:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938195.624447:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144176000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938195.626246:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144176512 00000100:00100000:1.0:1784938195.626259:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144176512 00000100:00100000:1.0:1784938195.626327:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:1.0:1784938195.626337:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144176512:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938195.626403:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144176512:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 68us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938195.626410:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:1.0:1784938195.626597:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144175872:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938195.626881:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb45c00 x1871643144176384/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938195.626893:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144176384:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938195.626906:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144175744:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938195.626918:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb46a00 x1871643144176256/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938195.626926:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144176256:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938195.626939:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd458380 x1871643144176768/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938195.626947:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144176768:192.168.203.126@tcp:400:kworker.0 00000100:00080000:0.0:1784938195.627195:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938195.627200:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938195.627203:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938195.627274:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb44000 x1871643144176512/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938195.627283:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144176512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938195.627630:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144175488 00000100:00100000:2.0:1784938195.627637:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144175488 00000100:00100000:2.0:1784938195.627678:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1784938195.627687:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144175488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938195.627758:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144175488:12345-0@lo:400:kworker.0 Request processed in 73us (4658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938195.627765:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1784938195.629356:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144175488:0@lo:400:kworker.0 00010000:00010000:2.0:1784938196.578719:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938196.642091:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144176896:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938196.642559:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938196.642575:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144177024:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938196.642867:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938196.642932:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938196.642962:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144176896 00000100:00100000:0.0:1784938196.642973:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144176896 00000100:00100000:0.0:1784938196.643016:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144177024 00000100:00100000:0.0:1784938196.643019:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144177024 00000100:00100000:0.0:1784938196.643035:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:0.0:1784938196.643044:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144176896:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938196.643079:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938196.643142:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144176896:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 98us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938196.643149:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:0.0:1784938196.643170:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 51 00000100:00100000:0.0:1784938196.643177:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144177024:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938196.643189:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938196.643208:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144177024:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938196.643245:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 51 00010000:00080000:0.0:1784938196.643673:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc676c000 x1871643144177024/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938196.643704:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144177024:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00080000:2.0:1784938196.644818:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd458380 x1871643144176896/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938196.644844:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144176896:192.168.203.126@tcp:13:osp-pre-0-1.0 00000001:02000400:2.0:1784938196.936562:0:11215:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.203 00010000:00010000:1.0:1784938197.603886:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938197.665646:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938197.665686:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144177152:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938197.668684:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938197.668786:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144177152 00000100:00100000:1.0:1784938197.668807:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144177152 00000100:00100000:1.0:1784938197.668889:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 91 00000100:00100000:1.0:1784938197.668902:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144177152:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:1.0:1784938197.668953:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784938197.693676:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144177152:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 24754us (24981us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938197.693707:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 91 00000100:00100000:0.0:1784938197.711621:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144177152:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938198.629562:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938198.650861:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938198.650915:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938198.650943:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938198.651070:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125229184 00000100:00100000:2.0:1784938198.651083:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125229184 00000100:00100000:3.0:1784938198.651122:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125229440 00000100:00100000:3.0:1784938198.651126:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125229440 00000100:00100000:2.0:1784938198.651147:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 287 00000100:00100000:2.0:1784938198.651158:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2394:x1871643125229184:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938198.651186:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125229312 00000100:00100000:3.0:1784938198.651190:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125229312 00000100:00100000:3.0:1784938198.651241:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00100000:3.0:1784938198.651249:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125229440:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938198.651359:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2394:x1871643125229184:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 201us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.651367:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 287 00000100:00100000:0.0:1784938198.651379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:0.0:1784938198.651389:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125229312:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:1.0:1784938198.651537:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938198.651543:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938198.654544:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125229440:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 3275us (3606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938198.654667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00100000:0.0:1784938198.668357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125229312:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 16947us (17389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938198.668379:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:0.0:1784938199.200523:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938199.200560:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144177280:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938199.200908:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938199.200943:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144177280 00000100:00100000:0.0:1784938199.200952:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144177280 00000100:00100000:0.0:1784938199.201038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 92 00000100:00100000:0.0:1784938199.201049:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144177280:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938199.201098:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938199.201155:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144177280:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 107us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938199.201165:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 92 00000100:00100000:0.0:1784938199.201550:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144177280:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:2.0:1784938199.647980:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784938200.025350:0:11312:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.203 00010000:00010000:1.0:1784938200.673354:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938200.735765:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144177408:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938200.736616:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938200.736802:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144177536:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938200.737564:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144177920:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.737630:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144178432:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.737674:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144178944:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.737706:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784938200.737712:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144177792:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.737732:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144178304:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.737753:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144178816:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938200.738461:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938200.738489:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938200.738514:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938200.740833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144178944 00000100:00100000:1.0:1784938200.740854:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144178944 00000100:00100000:1.0:1784938200.740951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144178304 00000100:00100000:1.0:1784938200.740956:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144178304 00000100:00100000:1.0:1784938200.740989:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 114 00000100:00100000:1.0:1784938200.741005:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144178944:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.741119:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144178944:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 120us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938200.741146:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 114 00000100:00100000:1.0:1784938200.741184:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 115 00000100:00100000:1.0:1784938200.741193:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144178304:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.741264:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144178304:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 73us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938200.741284:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 115 00000100:00100000:1.0:1784938200.741329:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144177664:0@lo:400:kworker.0 00000100:00100000:1.0:1784938200.741404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938200.741452:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144178176:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.741493:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144178688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.741526:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784938200.741534:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144178048:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.741579:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144178560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.741865:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938200.741911:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938200.741941:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938200.741960:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938200.741985:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144178688 00000100:00100000:1.0:1784938200.741991:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144178688 00000100:00100000:1.0:1784938200.742027:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144178560 00000100:00100000:1.0:1784938200.742030:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144178560 00000100:00100000:1.0:1784938200.742062:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:1.0:1784938200.742070:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144178688:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.742123:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144178688:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 53us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938200.742131:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:1.0:1784938200.742146:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:1.0:1784938200.742152:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144178560:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.742190:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144178560:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 38us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938200.742197:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:1.0:1784938200.742288:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144178304:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938200.742308:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587c000 x1871643144178944/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938200.742320:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144178944:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.742422:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144178048 00000100:00100000:1.0:1784938200.742426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144178048 00000100:00100000:1.0:1784938200.742453:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 116 00000100:00100000:1.0:1784938200.742460:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144178048:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.742491:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144178048:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938200.742498:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 116 00000100:00100000:1.0:1784938200.742593:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144178048:192.168.203.126@tcp:400:kworker.0 00000100:00080000:0.0:1784938200.743467:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938200.743476:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938200.743480:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938200.743506:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144177664 00000100:00100000:0.0:1784938200.743514:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144177664 00000100:00100000:0.0:1784938200.743578:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784938200.743588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3643:x1871643144177664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938200.743699:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3643:x1871643144177664:12345-0@lo:400:kworker.0 Request processed in 112us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938200.743706:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784938200.743748:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144177920 00000100:00100000:0.0:1784938200.743753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144177920 00000100:00100000:0.0:1784938200.743779:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144178176 00000100:00100000:0.0:1784938200.743782:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144178176 00000100:00100000:0.0:1784938200.743799:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 93 00000100:00100000:0.0:1784938200.743805:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144177920:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938200.743855:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144177920:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 49us (5400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938200.743860:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 93 00000100:00100000:0.0:1784938200.743872:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 94 00000100:00100000:0.0:1784938200.743876:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144178176:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938200.743900:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144178176:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938200.743905:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 94 00000100:00100000:0.0:1784938200.743960:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144177664:0@lo:400:kworker.0 00000100:00100000:2.0:1784938200.744806:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938200.752596:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938200.752633:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938200.752698:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938200.752797:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144178432 00000100:00100000:2.0:1784938200.752807:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144178432 00000100:00100000:2.0:1784938200.752871:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144177792 00000100:00100000:2.0:1784938200.752874:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144177792 00000100:00100000:2.0:1784938200.752886:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144178816 00000100:00100000:2.0:1784938200.752888:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144178816 00000100:00100000:2.0:1784938200.752908:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 117 00000100:00100000:2.0:1784938200.752919:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144178432:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.753005:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144178432:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 87us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938200.753013:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 117 00000100:00100000:2.0:1784938200.753034:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 118 00000100:00100000:2.0:1784938200.753040:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144177792:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.753089:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144177792:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 48us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938200.753096:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 118 00000100:00100000:2.0:1784938200.753110:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 119 00000100:00100000:2.0:1784938200.753116:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144178816:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.753140:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144178816:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938200.753146:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 119 00000100:00100000:1.0:1784938200.756746:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144177920:192.168.203.126@tcp:400:kworker.0 00000100:00080000:1.0:1784938200.756823:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938200.756854:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784938200.756891:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587ed80 x1871643144178560/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938200.756905:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144178560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938200.756921:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144178176:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938200.756935:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587dc00 x1871643144178688/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938200.756944:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144178688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.762473:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144177792:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938200.762499:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144178816:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938200.762517:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d82300 x1871643144178432/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938200.762752:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144178432:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938200.765949:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144177408 00000100:00100000:3.0:1784938200.765973:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144177408 00000100:00100000:3.0:1784938200.766108:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144177536 00000100:00100000:3.0:1784938200.766113:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144177536 00000100:00100000:3.0:1784938200.766148:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:3.0:1784938200.766160:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144177408:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938200.766232:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938200.766337:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144177408:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 178us (29725us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938200.766346:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:3.0:1784938200.766371:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:3.0:1784938200.766378:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144177536:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938200.766392:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938200.766414:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144177536:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 36us (21616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938200.766419:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00080000:2.0:1784938200.767528:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784938200.768312:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd459180 x1871643144177536/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938200.768348:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144177536:192.168.203.126@tcp:13:osp-pre-1-0.0 00010000:00080000:1.0:1784938200.768404:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc676df80 x1871643144177408/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938200.768419:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144177408:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00010000:3.0:1784938201.703374:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938201.762086:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144179072:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938201.762490:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938201.763406:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144179072 00000100:00100000:3.0:1784938201.763420:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144179072 00000100:00100000:3.0:1784938201.763734:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:3.0:1784938201.763748:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144179072:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938201.763791:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938201.763866:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144179072:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 121us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938201.763886:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:0.0:1784938201.764697:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144179200:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938201.764901:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:0.0:1784938201.764973:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4834380 x1871643144179072/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938201.765016:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144179072:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938201.765049:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144179200 00000100:00100000:0.0:1784938201.765055:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144179200 00000100:00100000:0.0:1784938201.765098:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:0.0:1784938201.765106:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144179200:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938201.765127:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938201.765164:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144179200:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 58us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938201.765171:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 55 00010000:00080000:2.0:1784938201.765554:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678d500 x1871643144179200/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938201.765570:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144179200:192.168.203.126@tcp:13:osp-pre-0-1.0 00000001:02000400:2.0:1784938201.970209:0:11361:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 24 20:09:59 EDT 2026 00010000:00010000:0.0:1784938202.728317:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938202.789230:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938202.789273:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144179328:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938202.789743:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938202.789970:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144179328 00000100:00100000:0.0:1784938202.789980:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144179328 00000100:00100000:0.0:1784938202.790044:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 95 00000100:00100000:0.0:1784938202.790054:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0196bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144179328:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938202.790095:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938202.790152:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0196bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144179328:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 99us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938202.790159:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 95 00000100:00100000:0.0:1784938202.796069:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144179328:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938203.744209:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938203.769948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938203.769994:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938203.770025:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938203.770053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125229696 00000100:00100000:0.0:1784938203.770061:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125229696 00000100:00100000:0.0:1784938203.770131:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125229824 00000100:00100000:0.0:1784938203.770134:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125229824 00000100:00100000:0.0:1784938203.770163:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:0.0:1784938203.770174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125229696:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938203.770278:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125229696:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 106us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938203.770285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:0.0:1784938203.770301:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:0.0:1784938203.770308:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125229824:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938203.770336:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125229824:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938203.770342:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00080000:0.0:1784938203.770358:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938203.770361:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938203.770659:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125229568 00000100:00100000:3.0:1784938203.770665:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125229568 00000100:00100000:3.0:1784938203.770699:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00100000:3.0:1784938203.770706:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2394:x1871643125229568:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938203.771744:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2394:x1871643125229568:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1032us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938203.771753:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00100000:2.0:1784938204.328933:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144179456:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938204.329282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938204.329312:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144179456 00000100:00100000:2.0:1784938204.329318:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144179456 00000100:00100000:2.0:1784938204.329364:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 96 00000100:00100000:2.0:1784938204.329373:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144179456:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:2.0:1784938204.329409:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784938204.329450:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144179456:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 77us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938204.329457:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 96 00000100:00100000:2.0:1784938204.329605:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144179456:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:3.0:1784938204.778439:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938205.791607:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938205.856938:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144179584:0@lo:400:kworker.0 00000100:00100000:3.0:1784938205.857018:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938205.857265:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144179712:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938205.857358:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938205.857368:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144179840:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938205.857532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938205.857642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938205.857667:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144179712 00000100:00100000:0.0:1784938205.857674:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144179712 00000100:00100000:0.0:1784938205.857715:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144179840 00000100:00100000:0.0:1784938205.857718:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144179840 00000100:00100000:0.0:1784938205.857735:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:0.0:1784938205.857743:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144179712:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938205.857788:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938205.857826:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144179712:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938205.857834:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:0.0:1784938205.857852:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00100000:0.0:1784938205.857858:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144179840:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938205.857868:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938205.857887:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144179840:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 30us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938205.857893:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00080000:0.0:1784938205.857914:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784938205.858043:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4834a80 x1871643144179840/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938205.858061:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144179840:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00080000:0.0:1784938205.858090:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678d500 x1871643144179712/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938205.858102:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144179712:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938205.862641:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938205.862673:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144180096:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.862928:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938205.862965:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144180096 00000100:00100000:0.0:1784938205.862973:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144180096 00000100:00100000:0.0:1784938205.863021:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 97 00000100:00100000:0.0:1784938205.863029:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144180096:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.863086:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144180096:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 58us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938205.863094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 97 00000100:00100000:0.0:1784938205.863197:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144180096:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.864294:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938205.864311:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144179968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.864516:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938205.864539:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144179968 00000100:00100000:0.0:1784938205.864544:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144179968 00000100:00100000:0.0:1784938205.864579:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 122 00000100:00100000:0.0:1784938205.864588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144179968:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.865175:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144179968:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 585us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938205.865184:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 122 00000100:00100000:0.0:1784938205.866478:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144179968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938205.868722:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144179584 00000100:00100000:3.0:1784938205.868733:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144179584 00000100:00100000:3.0:1784938205.868804:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1784938205.868813:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144179584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938205.868910:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144179584:12345-0@lo:400:kworker.0 Request processed in 98us (11892us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938205.868918:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1784938205.869526:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144179584:0@lo:400:kworker.0 00000100:00100000:0.0:1784938205.871660:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144180480:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.871744:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144180992:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.871775:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784938205.871781:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144180352:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.871804:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144180864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.871833:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144180224:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.871896:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144180736:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.871922:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784938205.871942:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144180608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.871974:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144181120:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.872171:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938205.872377:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144180608 00000100:00100000:1.0:1784938205.872384:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144180608 00000100:00100000:1.0:1784938205.872436:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 123 00000100:00100000:1.0:1784938205.872445:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144180608:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938205.872490:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144180608:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938205.872497:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 123 00000100:00080000:1.0:1784938205.872561:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938205.873613:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938205.873635:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938205.873654:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938205.873672:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938205.873692:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938205.873708:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938205.873725:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938205.873744:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144180864 00000100:00100000:1.0:1784938205.873748:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144180864 00000100:00100000:1.0:1784938205.873782:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144180736 00000100:00100000:1.0:1784938205.873785:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144180736 00000100:00100000:1.0:1784938205.873803:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:1.0:1784938205.873810:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144180864:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938205.873856:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144180864:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 46us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938205.873862:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:1.0:1784938205.873877:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:1.0:1784938205.873883:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144180736:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938205.874450:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144180736:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 565us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938205.874458:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:1.0:1784938205.874479:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144180480 00000100:00100000:1.0:1784938205.874483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144180480 00000100:00100000:1.0:1784938205.874503:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144180992 00000100:00100000:1.0:1784938205.874505:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144180992 00000100:00100000:1.0:1784938205.874516:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144180224 00000100:00100000:1.0:1784938205.874519:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144180224 00000100:00100000:1.0:1784938205.874528:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144181120 00000100:00100000:1.0:1784938205.874542:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144181120 00000100:00100000:1.0:1784938205.874560:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 124 00000100:00100000:1.0:1784938205.874566:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144180480:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938205.874593:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144180480:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938205.874599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 124 00000100:00100000:1.0:1784938205.874610:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 125 00000100:00100000:1.0:1784938205.874614:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144180992:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938205.874637:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144180992:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938205.874642:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 125 00000100:00100000:1.0:1784938205.874651:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 126 00000100:00100000:1.0:1784938205.874657:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144180224:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938205.874677:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144180224:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938205.874682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 126 00000100:00100000:1.0:1784938205.874693:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 127 00000100:00100000:1.0:1784938205.874700:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144181120:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938205.874721:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144181120:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938205.874727:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 127 00000100:00080000:1.0:1784938205.874750:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938205.874753:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938205.874756:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938205.875129:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144180352 00000100:00100000:2.0:1784938205.875134:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144180352 00000100:00100000:2.0:1784938205.875174:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 98 00000100:00100000:2.0:1784938205.875182:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144180352:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938205.875266:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144180352:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 85us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938205.875281:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 98 00000100:00100000:0.0:1784938205.875960:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144180352:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938205.875975:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd5dc700 x1871643144180864/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938205.875985:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144180864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.875996:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144180480:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.876006:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144180992:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938205.876438:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd5ddc00 x1871643144180608/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938205.876472:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144180608:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938205.876490:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd5dd180 x1871643144181120/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938205.876497:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144181120:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938205.876507:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144180224:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938205.876516:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd5dc000 x1871643144180736/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938205.876524:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144180736:192.168.203.126@tcp:400:kworker.0 00010000:00010000:0.0:1784938206.823670:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938206.879670:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144181248:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938206.880064:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938206.880094:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144181248 00000100:00100000:2.0:1784938206.880101:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144181248 00000100:00100000:2.0:1784938206.880142:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:2.0:1784938206.880150:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144181248:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938206.880177:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938206.880624:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144181248:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 473us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938206.880633:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:2.0:1784938206.880668:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144181376:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00080000:2.0:1784938206.896994:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4835f80 x1871643144181248/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938206.897020:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144181248:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938206.897163:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938206.897528:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144181376 00000100:00100000:2.0:1784938206.897535:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144181376 00000100:00100000:2.0:1784938206.897588:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 59 00000100:00100000:2.0:1784938206.897597:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144181376:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938206.897621:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938206.897692:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144181376:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 95us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938206.897700:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 59 00010000:00080000:2.0:1784938206.897816:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd5dc000 x1871643144181376/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938206.897852:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144181376:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00010000:3.0:1784938207.841828:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938207.903708:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938207.903750:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144181504:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938207.904090:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938207.904287:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144181504 00000100:00100000:1.0:1784938207.904295:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144181504 00000100:00100000:1.0:1784938207.904340:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 99 00000100:00100000:1.0:1784938207.904349:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144181504:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:1.0:1784938207.904384:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784938207.904439:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144181504:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 90us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938207.904445:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 99 00000100:00100000:1.0:1784938207.904875:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144181504:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:0.0:1784938208.866608:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938208.890446:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938208.890500:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938208.890553:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125229952 00000100:00100000:0.0:1784938208.890562:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125229952 00000100:00100000:0.0:1784938208.890620:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 291 00000100:00100000:0.0:1784938208.890630:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2394:x1871643125229952:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938208.890695:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2394:x1871643125229952:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938208.890702:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 291 00000100:00100000:1.0:1784938208.891178:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125230080 00000100:00100000:1.0:1784938208.891183:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125230080 00000100:00100000:1.0:1784938208.891262:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:1.0:1784938208.891279:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125230080:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938208.891317:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125230080:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 40us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938208.891323:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00080000:0.0:1784938208.891603:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938208.892785:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938208.892971:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125230208 00000100:00100000:0.0:1784938208.892979:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125230208 00000100:00100000:0.0:1784938208.893042:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:0.0:1784938208.893051:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125230208:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938208.893106:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125230208:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 56us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938208.893114:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00080000:2.0:1784938208.893636:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938209.439507:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144181632:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938209.440070:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938209.440136:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144181632 00000100:00100000:1.0:1784938209.440144:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144181632 00000100:00100000:1.0:1784938209.440207:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 100 00000100:00100000:1.0:1784938209.440466:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144181632:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938209.440502:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938209.440610:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144181632:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 395us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938209.443416:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144181632:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938209.444081:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 100 00010000:00010000:0.0:1784938209.888658:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938210.911515:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938210.975411:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144181888:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.975662:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938210.975687:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144181888 00000100:00100000:1.0:1784938210.975692:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144181888 00000100:00100000:1.0:1784938210.975731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 130 00000100:00100000:1.0:1784938210.975737:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144181888:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.975776:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144181888:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938210.975783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 130 00000100:00100000:1.0:1784938210.975817:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144182016:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.975869:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144182400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.975977:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144182528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.976022:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144182912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.976057:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144183040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.976152:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938210.976270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938210.976287:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938210.976300:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938210.976313:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938210.976326:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144183040 00000100:00100000:1.0:1784938210.976329:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144183040 00000100:00100000:1.0:1784938210.976351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144182400 00000100:00100000:1.0:1784938210.976353:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144182400 00000100:00100000:1.0:1784938210.976361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144182528 00000100:00100000:1.0:1784938210.976363:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144182528 00000100:00100000:1.0:1784938210.976371:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144182912 00000100:00100000:1.0:1784938210.976373:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144182912 00000100:00100000:1.0:1784938210.976382:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 131 00000100:00100000:1.0:1784938210.976387:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144183040:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.976412:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144183040:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938210.976418:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 131 00000100:00100000:1.0:1784938210.976428:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 132 00000100:00100000:1.0:1784938210.976432:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144182400:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.976448:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144182400:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938210.976462:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 132 00000100:00100000:1.0:1784938210.976475:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 133 00000100:00100000:1.0:1784938210.976481:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144182528:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.976500:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144182528:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 19us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938210.976506:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144182144:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.976508:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 133 00000100:00100000:1.0:1784938210.976520:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 134 00000100:00100000:1.0:1784938210.976527:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144182912:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938210.976549:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144182656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.976553:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144182912:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938210.976560:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 134 00000100:00100000:1.0:1784938210.976578:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144182016 00000100:00100000:1.0:1784938210.976581:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144182016 00000100:00100000:0.0:1784938210.976595:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784938210.976605:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144181760:0@lo:400:kworker.0 00000100:00100000:1.0:1784938210.976610:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 101 00000100:00100000:1.0:1784938210.976617:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144182016:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938210.976643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938210.976648:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144182016:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938210.976655:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 101 00000100:00080000:1.0:1784938210.976677:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938210.976677:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144182272:192.168.203.126@tcp:400:kworker.0 00000100:00080000:1.0:1784938210.976682:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938210.976707:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144182784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938210.976772:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144181760 00000100:00100000:0.0:1784938210.976776:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144181760 00000100:00100000:0.0:1784938210.976806:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1784938210.976814:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144181760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938210.976855:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144181760:12345-0@lo:400:kworker.0 Request processed in 43us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938210.976861:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1784938210.976878:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938210.976895:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144183168:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938210.976936:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938210.976942:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144181760:0@lo:400:kworker.0 00000100:00100000:1.0:1784938210.977005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938210.977037:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938210.977061:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938210.977077:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144182656 00000100:00100000:1.0:1784938210.977080:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144182656 00000100:00100000:1.0:1784938210.977100:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144182784 00000100:00100000:1.0:1784938210.977102:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144182784 00000100:00100000:1.0:1784938210.977114:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 51 00000100:00100000:1.0:1784938210.977119:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144182656:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.977142:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144182656:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938210.977147:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 51 00000100:00100000:1.0:1784938210.977156:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:1.0:1784938210.977160:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144182784:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.977174:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144182784:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 14us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938210.977179:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:1.0:1784938210.977194:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144182144 00000100:00100000:1.0:1784938210.977196:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144182144 00000100:00100000:1.0:1784938210.977382:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 135 00000100:00100000:1.0:1784938210.977388:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144182144:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.977408:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144182144:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938210.977413:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 135 00010000:00080000:3.0:1784938210.977588:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc676ed80 x1871643144182784/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938210.977600:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144182784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938210.977609:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144182144:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938210.977617:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc676ca80 x1871643144182656/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938210.977625:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144182656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938210.977677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144182272 00000100:00100000:3.0:1784938210.977681:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144183296:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938210.977683:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144182272 00000100:00100000:0.0:1784938210.977723:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 102 00000100:00100000:0.0:1784938210.977733:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144182272:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938210.977771:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144182272:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 40us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938210.977776:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938210.977786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 102 00000100:00100000:3.0:1784938210.977832:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144183168 00000100:00100000:3.0:1784938210.977835:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144183168 00000100:00100000:3.0:1784938210.977852:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144183296 00000100:00100000:3.0:1784938210.977854:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144183296 00000100:00100000:3.0:1784938210.977865:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:3.0:1784938210.977870:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144183168:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938210.977889:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938210.977918:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144183168:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 48us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938210.977923:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:3.0:1784938210.977935:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 61 00000100:00100000:3.0:1784938210.977941:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144183296:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938210.977960:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938210.977978:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144183296:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938210.977984:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 61 00000100:00100000:3.0:1784938210.978011:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144182272:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938210.978030:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4835f80 x1871643144183168/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938210.978044:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144183168:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00080000:3.0:1784938210.978106:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb54000 x1871643144183296/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938210.978115:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144183296:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00080000:1.0:1784938210.980467:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938210.980475:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938210.980515:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc676e300 x1871643144183040/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938210.980599:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144183040:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938210.980616:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd5dfb80 x1871643144182528/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938210.980624:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144182528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.980636:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144182016:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938210.981368:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144182912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938210.981380:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144182400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938210.981390:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144181888:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.981509:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144183424:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938210.985861:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938210.985913:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144183424 00000100:00100000:0.0:1784938210.985921:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144183424 00000100:00100000:0.0:1784938210.985976:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:0.0:1784938210.985987:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144183424:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938210.986068:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144183424:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938210.986075:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 53 00010000:00080000:3.0:1784938210.986323:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb54000 x1871643144183424/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938210.986338:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144183424:192.168.203.126@tcp:400:kworker.0 00010000:00010000:0.0:1784938211.938151:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938211.999533:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938211.999558:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144183552:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938211.999620:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938211.999633:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144183680:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938211.999924:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938211.999953:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144183680 00000100:00100000:1.0:1784938211.999959:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144183680 00000100:00100000:1.0:1784938212.000003:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:1.0:1784938212.000012:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144183680:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938212.000051:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938212.000091:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144183680:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 80us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938212.000098:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 62 00010000:00080000:0.0:1784938212.000392:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4835f80 x1871643144183680/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938212.000412:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144183680:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938212.001308:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938212.002837:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144183552 00000100:00100000:3.0:1784938212.002868:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144183552 00000100:00100000:3.0:1784938212.002939:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 63 00000100:00100000:3.0:1784938212.002950:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144183552:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938212.002974:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938212.003047:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144183552:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 100us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938212.003054:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 63 00010000:00080000:3.0:1784938212.003393:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587d500 x1871643144183552/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938212.003414:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144183552:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00080000:1.0:1784938212.004131:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784938212.965314:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938213.029570:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938213.029606:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144183808:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938213.029933:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938213.029981:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144183808 00000100:00100000:3.0:1784938213.029991:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144183808 00000100:00100000:3.0:1784938213.030055:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 103 00000100:00100000:3.0:1784938213.030069:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144183808:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938213.033486:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784938213.033631:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144183808:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 3558us (3695us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938213.033643:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 103 00000100:00100000:0.0:1784938213.035036:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144183808:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:0.0:1784938213.984228:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938214.007381:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938214.007458:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125230336 00000100:00100000:2.0:1784938214.007468:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125230336 00000100:00100000:2.0:1784938214.007535:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 293 00000100:00100000:2.0:1784938214.007545:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125230336:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938214.007610:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125230336:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938214.007617:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 293 00000100:00100000:1.0:1784938214.010555:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938214.010678:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125230464 00000100:00100000:2.0:1784938214.010687:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125230464 00000100:00100000:2.0:1784938214.010760:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:2.0:1784938214.010770:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125230464:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938214.010839:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125230464:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 70us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938214.010846:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00080000:1.0:1784938214.011179:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938214.018467:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938214.018556:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125230592 00000100:00100000:2.0:1784938214.018568:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125230592 00000100:00100000:2.0:1784938214.018639:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:2.0:1784938214.018649:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125230592:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938214.018736:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125230592:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938214.018744:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00080000:1.0:1784938214.019014:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938214.561791:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938214.561877:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144183936:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938214.562116:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938214.562149:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144183936 00000100:00100000:1.0:1784938214.562155:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144183936 00000100:00100000:1.0:1784938214.562246:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 104 00000100:00100000:1.0:1784938214.562256:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144183936:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938214.562292:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938214.562349:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144183936:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938214.562356:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 104 00000100:00100000:1.0:1784938214.562584:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144183936:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:1.0:1784938215.025475:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938216.032931:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938216.096438:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144184064:0@lo:400:kworker.0 00000100:00100000:3.0:1784938216.096509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938216.096577:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144184576:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096629:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144185088:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096712:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144185600:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096738:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784938216.096743:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144184448:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096761:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144184960:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096776:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144185472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096802:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144184192:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096820:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144184704:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096840:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144185216:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096859:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784938216.096865:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144184320:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096883:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144184832:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096902:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144185344:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.096932:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144184064 00000100:00100000:3.0:1784938216.096939:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144184064 00000100:00100000:3.0:1784938216.096983:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1784938216.096991:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144184064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938216.097039:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144184064:12345-0@lo:400:kworker.0 Request processed in 50us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.097055:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1784938216.097299:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097374:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097391:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097410:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097426:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097444:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097457:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097493:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097509:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097530:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097542:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938216.097563:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144184576 00000100:00100000:3.0:1784938216.097567:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144184576 00000100:00100000:3.0:1784938216.097588:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144184320 00000100:00100000:3.0:1784938216.097590:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144184320 00000100:00100000:3.0:1784938216.097604:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 105 00000100:00100000:3.0:1784938216.097610:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144184576:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.097650:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144184576:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 40us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.097656:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 105 00000100:00100000:3.0:1784938216.097669:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 106 00000100:00100000:3.0:1784938216.097676:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144184320:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.097704:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144184320:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.097720:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 106 00000100:00100000:3.0:1784938216.097738:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144185088 00000100:00100000:3.0:1784938216.097742:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144185088 00000100:00100000:3.0:1784938216.097766:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144185600 00000100:00100000:3.0:1784938216.097768:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144185600 00000100:00100000:3.0:1784938216.097777:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144184960 00000100:00100000:3.0:1784938216.097779:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144184960 00000100:00100000:3.0:1784938216.097787:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144185472 00000100:00100000:3.0:1784938216.097789:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144185472 00000100:00100000:3.0:1784938216.097799:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:3.0:1784938216.097805:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144185088:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.097826:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144185088:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.097832:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:3.0:1784938216.097843:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:3.0:1784938216.097848:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144185600:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.097868:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144185600:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.097873:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:3.0:1784938216.097883:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:3.0:1784938216.097889:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144184960:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.097909:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144184960:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.097914:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:3.0:1784938216.097924:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00100000:3.0:1784938216.097937:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144185472:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.097958:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144185472:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.097964:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00100000:3.0:1784938216.097980:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144184448 00000100:00100000:3.0:1784938216.097983:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144184448 00000100:00100000:3.0:1784938216.097996:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144184192 00000100:00100000:3.0:1784938216.097998:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144184192 00000100:00100000:3.0:1784938216.098005:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144184704 00000100:00100000:3.0:1784938216.098007:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144184704 00000100:00100000:3.0:1784938216.098016:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144185216 00000100:00100000:3.0:1784938216.098017:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144185216 00000100:00100000:3.0:1784938216.098025:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144184832 00000100:00100000:3.0:1784938216.098027:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144184832 00000100:00100000:3.0:1784938216.098035:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144185344 00000100:00100000:3.0:1784938216.098037:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144185344 00000100:00100000:3.0:1784938216.098047:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 138 00000100:00100000:3.0:1784938216.098052:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144184448:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098070:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144184448:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.098076:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 138 00000100:00100000:3.0:1784938216.098084:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 139 00000100:00100000:3.0:1784938216.098089:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144184192:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098104:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144184192:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 14us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.098109:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 139 00000100:00100000:3.0:1784938216.098116:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 140 00000100:00100000:3.0:1784938216.098127:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144184704:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098142:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144184704:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 17us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.098148:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 140 00000100:00100000:3.0:1784938216.098156:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 141 00000100:00100000:3.0:1784938216.098161:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144185216:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098188:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144185216:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.098193:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 141 00000100:00100000:3.0:1784938216.098203:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 142 00000100:00100000:3.0:1784938216.098208:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144184832:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098251:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144184832:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 43us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.098257:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 142 00000100:00100000:3.0:1784938216.098267:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 143 00000100:00100000:3.0:1784938216.098272:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144185344:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098289:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144185344:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 17us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938216.098294:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 143 00000100:00100000:3.0:1784938216.098591:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144184320:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938216.098606:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb54380 x1871643144184832/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938216.098616:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144184832:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938216.098637:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb54a80 x1871643144185344/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938216.098646:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144185344:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098659:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144184192:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098669:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144184704:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098677:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144185216:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098716:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144184448:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938216.098726:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb55500 x1871643144184960/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938216.098734:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144184960:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938216.098743:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb56680 x1871643144185472/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938216.098750:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144185472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938216.098760:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144184064:0@lo:400:kworker.0 00000100:00100000:3.0:1784938216.098769:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144184576:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938216.098779:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb54000 x1871643144185088/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938216.098787:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144185088:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938216.098796:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb55f80 x1871643144185600/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938216.098810:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144185600:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938216.099167:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938216.099190:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144185728:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938216.099358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938216.099380:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144185728 00000100:00100000:0.0:1784938216.099385:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144185728 00000100:00100000:0.0:1784938216.099418:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 64 00000100:00100000:0.0:1784938216.099425:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144185728:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938216.099450:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938216.099483:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144185728:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 57us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938216.099490:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 64 00010000:00080000:0.0:1784938216.099703:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4835f80 x1871643144185728/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938216.099719:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144185728:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00080000:1.0:1784938216.099867:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938216.099872:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938216.099875:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938216.099877:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938216.099886:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938216.099895:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144185856:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938216.099997:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938216.100014:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144185856 00000100:00100000:1.0:1784938216.100017:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144185856 00000100:00100000:1.0:1784938216.100039:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 65 00000100:00100000:1.0:1784938216.100045:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144185856:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938216.100056:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938216.100077:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144185856:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 32us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938216.100092:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 65 00010000:00080000:1.0:1784938216.100185:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d80e00 x1871643144185856/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938216.100199:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144185856:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00010000:0.0:1784938217.055563:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938217.119483:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144185984:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938217.119798:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938217.119823:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144185984 00000100:00100000:1.0:1784938217.119830:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144185984 00000100:00100000:1.0:1784938217.119875:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 66 00000100:00100000:1.0:1784938217.119884:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144185984:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938217.119913:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938217.119950:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144185984:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 67us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938217.119957:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 66 00010000:00080000:1.0:1784938217.120081:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d80e00 x1871643144185984/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938217.120100:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144185984:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938217.132276:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938217.132311:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144186112:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938217.132549:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938217.132579:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144186112 00000100:00100000:1.0:1784938217.132586:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144186112 00000100:00100000:1.0:1784938217.132630:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 67 00000100:00100000:1.0:1784938217.132639:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144186112:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938217.132671:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938217.132709:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144186112:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 72us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938217.132717:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 67 00010000:00080000:1.0:1784938217.133744:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb44000 x1871643144186112/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938217.133769:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144186112:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938218.079445:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938218.143846:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938218.143872:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144186240:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938218.145529:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938218.145610:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144186240 00000100:00100000:0.0:1784938218.145620:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144186240 00000100:00100000:0.0:1784938218.145682:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 107 00000100:00100000:0.0:1784938218.145691:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144186240:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938218.145729:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938218.145794:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144186240:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938218.145801:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 107 00000100:00100000:0.0:1784938218.146099:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144186240:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938219.104041:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938219.128596:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938219.128668:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938219.128707:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938219.128748:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125230976 00000100:00100000:3.0:1784938219.128760:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125230976 00000100:00100000:3.0:1784938219.128839:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125230848 00000100:00100000:3.0:1784938219.128843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125230848 00000100:00100000:3.0:1784938219.128872:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:3.0:1784938219.128883:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125230976:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938219.128979:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125230976:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 99us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938219.128988:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:3.0:1784938219.129010:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:3.0:1784938219.129016:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2393:x1871643125230848:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938219.129042:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2393:x1871643125230848:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938219.129048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00080000:3.0:1784938219.129066:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938219.129071:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938219.129197:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125230720 00000100:00100000:1.0:1784938219.129202:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125230720 00000100:00100000:1.0:1784938219.129276:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 295 00000100:00100000:1.0:1784938219.129284:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2393:x1871643125230720:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938219.129313:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2393:x1871643125230720:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 31us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938219.129318:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 295 00000100:00100000:2.0:1784938219.679538:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938219.679563:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144186368:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938219.679920:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938219.680086:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144186368 00000100:00100000:2.0:1784938219.680095:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144186368 00000100:00100000:2.0:1784938219.680160:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 108 00000100:00100000:2.0:1784938219.680169:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144186368:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:2.0:1784938219.680202:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938219.680533:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144186368:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938219.680619:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144186368:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 101us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938219.680639:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 108 00010000:00010000:0.0:1784938220.128849:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938220.427569:0:11990:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:10:18 (1784938218) === 00000100:00100000:3.0:1784938221.005780:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938221.005972:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125231104 00000100:00100000:2.0:1784938221.005985:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125231104 00000100:00100000:2.0:1784938221.006063:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 296 00000100:00100000:2.0:1784938221.006075:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:8725:x1871643125231104:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784938221.006098:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938221.006122:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7468e00/0x26783cd1c59ee377 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2857c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.006169:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7468e00/0x26783cd1c59ee377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2857c expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.006183:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7468e00/0x26783cd1c59ee377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2857c expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.009056:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7468e00, rc 0) 00000100:00100000:2.0:1784938221.009181:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8725:x1871643125231104:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 3103us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.011861:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 296 00000100:00100000:3.0:1784938221.024032:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.024176:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125231232 00000100:00100000:0.0:1784938221.024189:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125231232 00000100:00100000:0.0:1784938221.024553:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 297 00000100:00100000:0.0:1784938221.024572:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8725:x1871643125231232:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784938221.024794:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8725:x1871643125231232:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 231us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.024803:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 297 00000100:00100000:3.0:1784938221.031336:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938221.031483:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125231360 00000100:00100000:1.0:1784938221.031495:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125231360 00000100:00100000:1.0:1784938221.031568:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 298 00000100:00100000:1.0:1784938221.031580:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8725:x1871643125231360:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784938221.031772:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8725:x1871643125231360:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 194us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.031790:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 298 00000100:00100000:3.0:1784938221.036039:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938221.036917:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125231488 00000100:00100000:2.0:1784938221.036935:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125231488 00000100:00100000:2.0:1784938221.037014:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:2.0:1784938221.037027:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8729:x1871643125231488:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938221.037473:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8729:x1871643125231488:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 265us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.037484:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:1.0:1784938221.088778:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.088918:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125231616 00000100:00100000:0.0:1784938221.088931:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125231616 00000100:00100000:0.0:1784938221.089001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 300 00000100:00100000:0.0:1784938221.089012:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8729:x1871643125231616:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938221.089308:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8729:x1871643125231616:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 297us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.089318:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 300 00000100:00100000:3.0:1784938221.092981:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938221.093160:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125231744 00000100:00100000:1.0:1784938221.093172:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125231744 00000100:00100000:1.0:1784938221.093282:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 301 00000100:00100000:1.0:1784938221.093302:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8729:x1871643125231744:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938221.093509:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8729:x1871643125231744:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 216us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.093518:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 301 00000100:00100000:1.0:1784938221.105864:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938221.105976:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125231872 00000100:00100000:3.0:1784938221.105989:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125231872 00000100:00100000:3.0:1784938221.106056:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 302 00000100:00100000:3.0:1784938221.106067:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:8725:x1871643125231872:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938221.106089:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938221.106112:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cd9246e00/0x26783cd1c59ee37e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a285ad expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938221.106163:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cd9246e00/0x26783cd1c59ee37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ad expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938221.106178:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cd9246e00/0x26783cd1c59ee37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ad expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938221.106189:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cd9246e00, rc 0) 00000100:00100000:3.0:1784938221.106322:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:8725:x1871643125231872:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 256us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.106330:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 302 00000100:00100000:3.0:1784938221.114320:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.114490:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125232000 00000100:00100000:0.0:1784938221.114503:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125232000 00000100:00100000:0.0:1784938221.114577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 303 00000100:00100000:0.0:1784938221.114588:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:8725:x1871643125232000:12345-192.168.203.26@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784938221.114623:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784938221.114651:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784938221.114656:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784938221.114659:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784938221.114662:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784938221.114670:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1784938221.119095:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:8725:x1871643125232000:12345-192.168.203.26@tcp:256:mount.lustre.0 Request processed in 4493us (4773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.119113:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 303 00000100:00100000:1.0:1784938221.122543:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938221.123071:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125232128 00000100:00100000:3.0:1784938221.123085:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125232128 00000100:00100000:3.0:1784938221.123317:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 304 00000100:00100000:3.0:1784938221.123329:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:8725:x1871643125232128:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938221.123366:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938221.123390:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a285b4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938221.123428:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285b4 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938221.123442:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285b4 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938221.123452:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cd9247600, rc 0) 00000100:00100000:3.0:1784938221.123520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:8725:x1871643125232128:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 194us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.123528:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 304 00000100:00100000:1.0:1784938221.131304:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938221.131444:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125232256 00000100:00100000:3.0:1784938221.131457:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125232256 00000100:00100000:3.0:1784938221.131523:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 305 00000100:00100000:3.0:1784938221.131536:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:8725:x1871643125232256:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784938221.131742:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:8725:x1871643125232256:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 208us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.131751:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 305 00000100:00100000:0.0:1784938221.133856:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938221.134035:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125232384 00000100:00100000:3.0:1784938221.134048:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125232384 00000100:00100000:3.0:1784938221.134118:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 306 00000100:00100000:3.0:1784938221.134129:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:8725:x1871643125232384:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784938221.134372:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:8725:x1871643125232384:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 243us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.134387:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 306 00000100:00100000:1.0:1784938221.136871:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938221.140073:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125232512 00000100:00100000:2.0:1784938221.140093:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125232512 00000100:00100000:2.0:1784938221.140882:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 307 00000100:00100000:2.0:1784938221.140900:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:8734:x1871643125232512:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938221.141205:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:8734:x1871643125232512:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 308us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.141249:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 307 00010000:00010000:1.0:1784938221.152838:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938221.155684:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.162126:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125232640 00000100:00100000:0.0:1784938221.162243:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125232640 00000100:00100000:2.0:1784938221.162575:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 308 00000100:00100000:2.0:1784938221.162588:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:8734:x1871643125232640:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938221.162857:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:8734:x1871643125232640:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 270us (7186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.162867:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 308 00000100:00100000:0.0:1784938221.169666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.169746:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.169828:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938221.169897:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125233408 00000100:00100000:3.0:1784938221.169909:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125233408 00000100:00100000:3.0:1784938221.169990:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125233536 00000100:00100000:3.0:1784938221.169994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125233536 00000100:00100000:3.0:1784938221.170023:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:3.0:1784938221.170034:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125233408:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.170126:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125233408:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 94us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.170134:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:3.0:1784938221.170167:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:3.0:1784938221.170173:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125233536:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.170201:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125233536:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.170207:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00080000:2.0:1784938221.170373:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938221.170379:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938221.172116:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938221.172411:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125232768 00000100:00100000:1.0:1784938221.172423:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125232768 00000100:00100000:1.0:1784938221.172479:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125233024 00000100:00100000:1.0:1784938221.172483:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125233024 00000100:00100000:1.0:1784938221.172498:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:1.0:1784938221.172506:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1871643125232768:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784938221.172542:0:6513:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from 2e0e55a1-2fc4-4192-a43b-67b180b29a8a@192.168.203.26@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1784938221.172605:0:6513:0:(genops.c:1406:class_connect()) connect: client 2e0e55a1-2fc4-4192-a43b-67b180b29a8a, cookie 0x26783cd1c59ee38c 00000004:00100000:1.0:1784938221.172639:0:6513:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784938221.172786:0:6513:0:(import.c:65:import_set_state_nolock()) ffff910bc7c65000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938221.172874:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2391:x1871643125232768:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 368us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.172899:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:1.0:1784938221.172921:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1784938221.172926:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1871643125233024:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784938221.172941:0:6513:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from 2e0e55a1-2fc4-4192-a43b-67b180b29a8a@192.168.203.26@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1784938221.172964:0:6513:0:(genops.c:1406:class_connect()) connect: client 2e0e55a1-2fc4-4192-a43b-67b180b29a8a, cookie 0x26783cd1c59ee393 00000004:00100000:1.0:1784938221.172977:0:6513:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784938221.173038:0:6513:0:(import.c:65:import_set_state_nolock()) ffff910bc7c64000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938221.173062:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2391:x1871643125233024:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 135us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.173069:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1784938221.177506:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938221.177565:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.177860:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125233152 00000100:00100000:0.0:1784938221.177872:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125233152 00000100:00100000:0.0:1784938221.177946:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125232896 00000100:00100000:0.0:1784938221.177949:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125232896 00000100:00100000:0.0:1784938221.177975:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1784938221.177985:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:0:x1871643125233152:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938221.178034:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938221.178150:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:0:x1871643125233152:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 153us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.178159:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1784938221.178178:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1784938221.178184:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:0:x1871643125232896:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938221.178204:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938221.178281:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:0:x1871643125232896:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 96us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.178288:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00080000:0.0:1784938221.178307:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938221.178312:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938221.178814:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.179009:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125233280 00000100:00100000:0.0:1784938221.179015:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125233280 00000100:00100000:0.0:1784938221.179065:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1784938221.179074:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:8725:x1871643125233280:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938221.179099:0:9526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938221.179159:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:8725:x1871643125233280:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 85us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.179166:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:1.0:1784938221.181727:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.181874:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125233664 00000100:00100000:0.0:1784938221.181885:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125233664 00000100:00100000:0.0:1784938221.181952:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1784938221.181963:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:8725:x1871643125233664:12345-192.168.203.26@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784938221.182075:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:8725:x1871643125233664:12345-192.168.203.26@tcp:40:mount.lustre.0 Request processed in 114us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.182083:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1784938221.185849:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.185895:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.185940:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938221.186259:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125233792 00000100:00100000:3.0:1784938221.186281:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125233792 00000100:00100000:3.0:1784938221.186335:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125233920 00000100:00100000:3.0:1784938221.186338:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125233920 00000100:00100000:3.0:1784938221.186362:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:3.0:1784938221.186370:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1871643125233792:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784938221.186415:0:8429:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 2e0e55a1-2fc4-4192-a43b-67b180b29a8a@192.168.203.26@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:3.0:1784938221.186453:0:8429:0:(genops.c:1406:class_connect()) connect: client 2e0e55a1-2fc4-4192-a43b-67b180b29a8a, cookie 0x26783cd1c59ee39a 00002000:00100000:3.0:1784938221.186468:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e0e55a1-2fc4-4192-a43b-67b180b29a8a/ffff910bc7cb8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784938221.186509:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1784938221.186755:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125234048 00000100:00100000:1.0:1784938221.186760:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125234048 00000100:00100000:1.0:1784938221.186806:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:1.0:1784938221.186814:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:8725:x1871643125234048:12345-192.168.203.26@tcp:900:mount.lustre.0 00000100:00100000:2.0:1784938221.186930:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1784938221.186940:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2391:x1871643125233920:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784938221.186965:0:8770:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 2e0e55a1-2fc4-4192-a43b-67b180b29a8a@192.168.203.26@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1784938221.186992:0:8770:0:(genops.c:1406:class_connect()) connect: client 2e0e55a1-2fc4-4192-a43b-67b180b29a8a, cookie 0x26783cd1c59ee3a1 00002000:00100000:2.0:1784938221.186999:0:8770:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e0e55a1-2fc4-4192-a43b-67b180b29a8a/ffff910cffbca800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784938221.187015:0:8770:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784938221.187097:0:8770:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1784938221.187835:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:8725:x1871643125234048:12345-192.168.203.26@tcp:900:mount.lustre.0 Request processed in 1015us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.187846:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00002000:00080000:3.0:1784938221.187995:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784938221.188019:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910bc7cbd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938221.188056:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2391:x1871643125233792:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 1687us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.188064:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00080000:2.0:1784938221.188569:0:8770:0:(import.c:65:import_set_state_nolock()) ffff910cffbc8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938221.188693:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2391:x1871643125233920:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 1753us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.188703:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1784938221.192804:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938221.193102:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125234176 00000100:00100000:0.0:1784938221.193115:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125234176 00000100:00100000:1.0:1784938221.193873:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:1.0:1784938221.193890:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:8725:x1871643125234176:12345-192.168.203.26@tcp:33:mount.lustre.0 00000004:00200000:1.0:1784938221.194018:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784938221.194131:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:8725:x1871643125234176:12345-192.168.203.26@tcp:33:mount.lustre.0 Request processed in 247us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.194151:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:3.0:1784938221.216434:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938221.216475:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144186496:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938221.217047:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938221.217083:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144186496 00000100:00100000:0.0:1784938221.217093:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144186496 00000100:00100000:0.0:1784938221.217177:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 68 00000100:00100000:0.0:1784938221.217189:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfdb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144186496:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938221.217245:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938221.217300:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfdb92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144186496:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 113us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.217328:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 68 00000100:00080000:0.0:1784938221.217594:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784938221.217913:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc489df80 x1871643144186496/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938221.217937:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144186496:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938221.218274:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144186752:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.218339:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144187264:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.218366:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144187776:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.218387:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784938221.218392:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144186880:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.218410:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144187392:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.218426:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144187904:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.218561:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938221.218607:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938221.218629:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938221.218652:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938221.218669:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938221.218704:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938221.218731:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144186752 00000100:00100000:2.0:1784938221.218737:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144186752 00000100:00100000:2.0:1784938221.218767:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144187264 00000100:00100000:2.0:1784938221.218769:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144187264 00000100:00100000:2.0:1784938221.218788:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144187776 00000100:00100000:2.0:1784938221.218791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144187776 00000100:00100000:2.0:1784938221.218800:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144187392 00000100:00100000:2.0:1784938221.218802:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144187392 00000100:00100000:2.0:1784938221.218812:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144187904 00000100:00100000:2.0:1784938221.218814:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144187904 00000100:00100000:2.0:1784938221.218828:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 148 00000100:00100000:2.0:1784938221.218836:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144186752:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.218877:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144186752:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 42us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.218884:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 148 00000100:00100000:2.0:1784938221.218900:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 149 00000100:00100000:2.0:1784938221.218905:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144187264:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.218922:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144187264:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 17us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.218928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 149 00000100:00100000:2.0:1784938221.218937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 150 00000100:00100000:2.0:1784938221.218942:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144187776:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.218957:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144187776:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 15us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.218963:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 150 00000100:00100000:2.0:1784938221.218972:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 151 00000100:00100000:2.0:1784938221.218977:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144187392:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.219000:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144187392:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.219006:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 151 00000100:00100000:2.0:1784938221.219015:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 152 00000100:00100000:2.0:1784938221.219020:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144187904:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.219034:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144187904:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 14us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.219039:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 152 00000100:00080000:2.0:1784938221.219053:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938221.219056:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784938221.219210:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc76cd880 x1871643144187392/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938221.219254:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144187392:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938221.219266:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc76cce00 x1871643144187904/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938221.219275:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144187904:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.219284:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144186752:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.219292:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144187264:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.219299:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144187776:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.219493:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144186624:0@lo:400:kworker.0 00000100:00100000:3.0:1784938221.219539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938221.219567:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144187136:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.219603:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144187648:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.219632:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784938221.219640:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144187008:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.219663:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144187520:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.219683:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144188032:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.219803:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938221.219830:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938221.219853:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938221.219882:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938221.219903:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938221.219924:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144186880 00000100:00100000:3.0:1784938221.219930:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144186880 00000100:00100000:3.0:1784938221.219963:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144187136 00000100:00100000:3.0:1784938221.219965:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144187136 00000100:00100000:3.0:1784938221.219979:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 109 00000100:00100000:3.0:1784938221.219985:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144186880:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.220027:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144186880:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 41us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.220034:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 109 00000100:00100000:3.0:1784938221.220051:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 110 00000100:00100000:3.0:1784938221.220057:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144187136:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.220076:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144187136:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.220082:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 110 00000100:00100000:3.0:1784938221.220098:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144187648 00000100:00100000:3.0:1784938221.220102:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144187648 00000100:00100000:3.0:1784938221.220127:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144187520 00000100:00100000:3.0:1784938221.220129:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144187520 00000100:00100000:0.0:1784938221.220431:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144188032 00000100:00100000:0.0:1784938221.220435:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144188032 00000100:00100000:0.0:1784938221.220461:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:0.0:1784938221.220469:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144187648:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938221.220500:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144187648:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.220506:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:0.0:1784938221.220518:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 59 00000100:00100000:0.0:1784938221.220524:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144188032:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938221.220545:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144188032:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.220707:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:3.0:1784938221.220714:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144187520:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938221.220741:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144187520:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.220747:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:1.0:1784938221.221069:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938221.221090:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144188160:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938221.221297:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:1.0:1784938221.221351:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc76cea00 x1871643144187520/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938221.221367:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144187520:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938221.221377:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc76cdf80 x1871643144188032/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938221.221385:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144188032:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938221.221395:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144187136:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938221.221405:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc76cc380 x1871643144187648/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938221.221413:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144187648:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938221.221450:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144188160 00000100:00100000:1.0:1784938221.221455:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144188160 00000100:00100000:1.0:1784938221.221489:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 69 00000100:00100000:1.0:1784938221.221511:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1871643144188160:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938221.221534:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938221.221570:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1871643144188160:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 59us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.221577:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 69 00010000:00080000:1.0:1784938221.221664:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc489f480 x1871643144188160/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938221.221680:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144188160:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938221.222330:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 59 00000100:00080000:2.0:1784938221.227650:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938221.227665:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938221.227743:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144186880:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.227825:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144187008 00000100:00100000:2.0:1784938221.227835:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144187008 00000100:00100000:2.0:1784938221.227913:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 153 00000100:00100000:2.0:1784938221.227925:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144187008:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.228032:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144187008:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 108us (8175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.228041:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 153 00000100:00100000:2.0:1784938221.228121:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144186624 00000100:00100000:2.0:1784938221.228126:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144186624 00000100:00100000:1.0:1784938221.228800:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144187008:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938221.231633:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784938221.231656:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144186624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938221.231777:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144186624:12345-0@lo:400:kworker.0 Request processed in 130us (12236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938221.231785:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1784938221.232106:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144186624:0@lo:400:kworker.0 00010000:00010000:1.0:1784938222.182117:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938222.239860:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144188288:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938222.240027:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938222.240035:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144188416:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938222.240387:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938222.240483:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938222.240879:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144188288 00000100:00100000:1.0:1784938222.240890:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144188288 00000100:00100000:1.0:1784938222.240938:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144188416 00000100:00100000:1.0:1784938222.240941:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144188416 00000100:00100000:1.0:1784938222.240960:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 70 00000100:00100000:1.0:1784938222.240969:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144188288:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938222.241000:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938222.241080:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144188288:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 112us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938222.241089:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 70 00000100:00100000:1.0:1784938222.241110:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 71 00000100:00100000:1.0:1784938222.241116:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144188416:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938222.241126:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938222.241177:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144188416:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 61us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938222.241183:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 71 00010000:00080000:0.0:1784938222.241485:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb55f80 x1871643144188416/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938222.241510:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144188416:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00080000:0.0:1784938222.241524:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d81180 x1871643144188288/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938222.241535:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144188288:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00010000:0.0:1784938223.201304:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938223.263448:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938223.263485:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144188544:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938223.264020:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938223.264099:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144188544 00000100:00100000:1.0:1784938223.264109:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144188544 00000100:00100000:1.0:1784938223.264183:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 111 00000100:00100000:1.0:1784938223.264193:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144188544:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:1.0:1784938223.264263:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784938223.264321:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144188544:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 128us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938223.264329:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 111 00000100:00100000:2.0:1784938223.264543:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144188544:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:0.0:1784938224.224537:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938224.801507:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938224.801534:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144188672:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938224.801777:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938224.801807:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144188672 00000100:00100000:2.0:1784938224.801822:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144188672 00000100:00100000:2.0:1784938224.801866:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 112 00000100:00100000:2.0:1784938224.801876:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144188672:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:2.0:1784938224.801910:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784938224.801953:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144188672:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938224.801960:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 112 00000100:00100000:2.0:1784938224.802095:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144188672:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938225.251353:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938226.273265:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938226.296773:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938226.296816:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938226.296848:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938226.296880:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938226.296904:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938226.296921:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938226.296942:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938226.296967:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125235072 00000100:00100000:2.0:1784938226.296975:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125235072 00000100:00100000:2.0:1784938226.297024:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125234944 00000100:00100000:2.0:1784938226.297027:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125234944 00000100:00100000:2.0:1784938226.297048:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:2.0:1784938226.297070:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2395:x1871643125235072:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938226.297150:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2395:x1871643125235072:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938226.297254:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125234560 00000100:00100000:0.0:1784938226.297258:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125234560 00000100:00100000:0.0:1784938226.297281:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125234816 00000100:00100000:0.0:1784938226.297283:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125234816 00000100:00100000:0.0:1784938226.297293:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125234432 00000100:00100000:0.0:1784938226.297295:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125234432 00000100:00100000:0.0:1784938226.297305:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125234688 00000100:00100000:0.0:1784938226.297307:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125234688 00000100:00100000:0.0:1784938226.297319:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:0.0:1784938226.297325:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125234560:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938226.297356:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125234560:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 31us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938226.297363:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:0.0:1784938226.297379:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 155 00000100:00100000:0.0:1784938226.297385:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2395:x1871643125234816:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938226.297405:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2395:x1871643125234816:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 21us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938226.297412:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 155 00000100:00100000:0.0:1784938226.297422:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 156 00000100:00100000:0.0:1784938226.297427:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125234432:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938226.297448:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125234432:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 21us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938226.297454:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 156 00000100:00100000:0.0:1784938226.297463:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:0.0:1784938226.297469:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2395:x1871643125234688:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938226.297519:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2395:x1871643125234688:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 50us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938226.297526:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:3.0:1784938226.297759:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125234304 00000100:00100000:3.0:1784938226.297764:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125234304 00000100:00100000:3.0:1784938226.297802:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 310 00000100:00100000:3.0:1784938226.297809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125234304:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938226.297834:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125234304:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938226.297841:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 310 00000100:00100000:2.0:1784938226.297928:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:2.0:1784938226.297944:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:2.0:1784938226.297950:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2395:x1871643125234944:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938226.297983:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2395:x1871643125234944:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 33us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.297989:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00080000:2.0:1784938226.298012:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938226.298017:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938226.298019:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938226.298022:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938226.335863:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144188800:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938226.336848:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938226.336885:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144188800 00000100:00100000:3.0:1784938226.336904:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144188800 00000100:00100000:3.0:1784938226.336966:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 72 00000100:00100000:3.0:1784938226.336976:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144188800:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938226.337007:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938226.337051:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144188800:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938226.337059:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 72 00000100:00080000:3.0:1784938226.337084:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938226.337757:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938226.337772:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144188928:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938226.337998:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938226.338022:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144188928 00000100:00100000:2.0:1784938226.338028:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144188928 00000100:00100000:2.0:1784938226.338067:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 73 00000100:00100000:2.0:1784938226.338076:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144188928:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938226.338090:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938226.338135:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144188928:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 60us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.338142:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 73 00000100:00080000:2.0:1784938226.338256:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784938226.338335:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb56680 x1871643144188928/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938226.338353:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144188928:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00080000:2.0:1784938226.338364:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc489e680 x1871643144188800/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938226.338397:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144188800:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938226.339167:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144189184:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.339256:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144189696:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.339281:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144190208:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.339305:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784938226.339311:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144189056:0@lo:400:kworker.0 00000100:00100000:1.0:1784938226.339346:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938226.339371:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144189568:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.339394:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144190080:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.339438:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144189440:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.339466:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144189952:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.339502:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784938226.339519:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144189312:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.339545:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144189824:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.339898:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144190336:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938226.340210:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938226.340317:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938226.340395:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938226.340415:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938226.340457:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938226.340476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938226.340507:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938226.340526:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938226.340538:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938226.340553:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938226.341003:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144189568 00000100:00100000:2.0:1784938226.341011:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144189568 00000100:00100000:2.0:1784938226.341712:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144189312 00000100:00100000:2.0:1784938226.341719:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144189312 00000100:00100000:2.0:1784938226.341745:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 113 00000100:00100000:2.0:1784938226.341752:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144189568:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938226.341856:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 114 00000100:00100000:0.0:1784938226.341865:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144189312:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.341930:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144189824 00000100:00100000:1.0:1784938226.341935:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144189824 00000100:00100000:1.0:1784938226.341970:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144189184 00000100:00100000:1.0:1784938226.341973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144189184 00000100:00100000:1.0:1784938226.341984:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144189696 00000100:00100000:1.0:1784938226.341987:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144189696 00000100:00100000:1.0:1784938226.341998:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144190208 00000100:00100000:1.0:1784938226.342001:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144190208 00000100:00100000:1.0:1784938226.342013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144189440 00000100:00100000:1.0:1784938226.342015:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144189440 00000100:00100000:1.0:1784938226.342025:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144190336 00000100:00100000:1.0:1784938226.342028:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144190336 00000100:00100000:1.0:1784938226.342043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 158 00000100:00100000:1.0:1784938226.342049:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144189824:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938226.342135:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144189056 00000100:00100000:3.0:1784938226.342141:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144189056 00000100:00100000:3.0:1784938226.342179:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1784938226.342187:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144189056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938226.342288:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144189568:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 534us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.342295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 113 00000100:00100000:2.0:1784938226.342325:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144189952 00000100:00100000:2.0:1784938226.342329:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144189952 00000100:00100000:2.0:1784938226.342350:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144190080 00000100:00100000:2.0:1784938226.342353:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144190080 00000100:00100000:2.0:1784938226.342372:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 63 00000100:00100000:2.0:1784938226.342377:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144189952:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938226.342404:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144189952:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.342410:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 63 00000100:00100000:2.0:1784938226.342440:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 64 00000100:00100000:2.0:1784938226.342447:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144190080:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938226.342470:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144190080:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.342476:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 64 00000100:00100000:2.0:1784938226.342524:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 159 00000100:00100000:2.0:1784938226.342531:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144189184:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938226.342553:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144189184:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.342567:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 159 00000100:00100000:2.0:1784938226.342580:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 160 00000100:00100000:2.0:1784938226.342584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144189696:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938226.342604:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144189696:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.342608:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 160 00000100:00100000:2.0:1784938226.342616:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 161 00000100:00100000:2.0:1784938226.342621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144190208:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938226.342636:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144190208:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.342641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 161 00000100:00100000:2.0:1784938226.342649:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 162 00000100:00100000:2.0:1784938226.342654:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144189440:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938226.342673:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144189440:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.342678:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 162 00000100:00100000:2.0:1784938226.342686:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 163 00000100:00100000:2.0:1784938226.342691:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144190336:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938226.342707:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144190336:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938226.342718:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 163 00000100:00080000:2.0:1784938226.342733:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938226.342737:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938226.342739:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938226.351787:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144189312:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 9912us (11235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938226.351803:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 114 00000100:00100000:1.0:1784938226.352120:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144189824:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 10068us (11813us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938226.352129:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 158 00000100:00100000:1.0:1784938226.352380:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144189312:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938226.352400:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7cc9c00 x1871643144190336/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938226.352410:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144190336:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.352422:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144189440:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938226.352469:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc489df80 x1871643144189952/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938226.352479:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144189952:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.352694:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144189568:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938226.352708:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd458e00 x1871643144190080/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938226.352717:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144190080:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.352731:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144189184:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.352743:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144189696:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938226.352755:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144190208:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938226.352873:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc489f480 x1871643144189824/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938226.352883:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144189824:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938226.353451:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144189056:12345-0@lo:400:kworker.0 Request processed in 11261us (14101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938226.353463:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1784938226.355386:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144189056:0@lo:400:kworker.0 00000001:00100000:3.0:1784938226.857493:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000001:00100000:1.0:1784938226.864322:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000001:00100000:2.0:1784938226.864647:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000001:00100000:1.0:1784938226.868663:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00010000:00010000:0.0:1784938227.295548:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938227.359500:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938227.359531:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938227.359535:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144190464:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938227.359560:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144190592:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938227.360392:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938227.360477:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144190592 00000100:00100000:3.0:1784938227.360486:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144190592 00000100:00100000:3.0:1784938227.360548:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 74 00000100:00100000:3.0:1784938227.360558:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144190592:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938227.360597:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938227.360638:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144190592:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938227.360645:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 74 00000100:00100000:1.0:1784938227.361042:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938227.361168:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144190464 00000100:00100000:3.0:1784938227.361173:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144190464 00000100:00100000:3.0:1784938227.361204:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 75 00000100:00100000:3.0:1784938227.361210:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144190464:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938227.361248:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938227.361292:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144190464:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938227.361299:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 75 00010000:00080000:1.0:1784938227.361492:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d82300 x1871643144190464/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938227.361523:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144190464:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00080000:2.0:1784938227.361713:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb55500 x1871643144190592/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938227.361729:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144190592:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:0.0:1784938228.334882:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938228.383508:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938228.383540:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144190720:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938228.384112:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938228.384174:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144190720 00000100:00100000:3.0:1784938228.384182:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144190720 00000100:00100000:3.0:1784938228.384264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 115 00000100:00100000:3.0:1784938228.384274:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144190720:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938228.384309:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784938228.384368:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144190720:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938228.384377:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 115 00000100:00100000:1.0:1784938228.384621:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144190720:192.168.203.126@tcp:41:osp-pre-0-1.0 00000001:02000400:3.0:1784938228.766681:0:12183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1784938229.343469:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938229.924366:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938229.924393:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144190848:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938229.924653:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938229.924685:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144190848 00000100:00100000:0.0:1784938229.924691:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144190848 00000100:00100000:0.0:1784938229.924776:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 116 00000100:00100000:0.0:1784938229.924784:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144190848:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938229.924821:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938229.924863:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144190848:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938229.924871:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 116 00000100:00100000:2.0:1784938229.925807:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144190848:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938230.373567:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938231.393364:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938231.418350:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938231.418435:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938231.418467:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938231.418500:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938231.418525:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938231.418545:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938231.418571:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938231.418598:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125235968 00000100:00100000:2.0:1784938231.418606:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125235968 00000100:00100000:2.0:1784938231.418656:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125235840 00000100:00100000:2.0:1784938231.418659:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125235840 00000100:00100000:2.0:1784938231.418692:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:2.0:1784938231.418702:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125235968:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.418785:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125235968:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.418806:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:2.0:1784938231.418824:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1784938231.418831:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125235840:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.418859:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125235840:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.418865:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1784938231.418884:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125235456 00000100:00100000:2.0:1784938231.418887:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125235456 00000100:00100000:2.0:1784938231.418908:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125235712 00000100:00100000:2.0:1784938231.418910:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125235712 00000100:00100000:2.0:1784938231.418920:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125235328 00000100:00100000:2.0:1784938231.418922:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125235328 00000100:00100000:2.0:1784938231.418932:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125235584 00000100:00100000:2.0:1784938231.418934:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125235584 00000100:00100000:2.0:1784938231.418947:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:2.0:1784938231.418953:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125235456:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.418980:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125235456:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.418987:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:2.0:1784938231.418998:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:2.0:1784938231.419004:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125235712:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.419029:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125235712:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.419035:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:2.0:1784938231.419047:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00100000:2.0:1784938231.419059:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125235328:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.419096:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125235328:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 37us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.419102:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00100000:0.0:1784938231.419453:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125235200 00000100:00100000:0.0:1784938231.419459:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125235200 00000100:00100000:0.0:1784938231.419491:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 312 00000100:00100000:0.0:1784938231.419498:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2394:x1871643125235200:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938231.419525:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2394:x1871643125235200:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938231.419531:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 312 00000100:00080000:0.0:1784938231.419711:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938231.419716:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938231.419719:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938231.419721:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938231.422451:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:1.0:1784938231.422514:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125235584:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938231.422590:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125235584:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 126us (4044us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938231.422599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:2.0:1784938231.457348:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144190976:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938231.458417:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938231.458683:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144191360:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.458730:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144191872:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.458751:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144192384:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.458771:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784938231.458776:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144191488:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.458792:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144192000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.458815:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144192512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.458933:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938231.459053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938231.459096:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938231.459254:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938231.459271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938231.459291:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938231.459315:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144191360 00000100:00100000:2.0:1784938231.459322:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144191360 00000100:00100000:2.0:1784938231.459359:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 117 00000100:00100000:2.0:1784938231.459367:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144191360:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.459424:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144191360:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 58us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.459432:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 117 00000100:00100000:2.0:1784938231.459454:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144191872 00000100:00100000:2.0:1784938231.459456:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144191872 00000100:00100000:2.0:1784938231.459480:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144192384 00000100:00100000:2.0:1784938231.459483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144192384 00000100:00100000:2.0:1784938231.459492:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144191488 00000100:00100000:2.0:1784938231.459494:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144191488 00000100:00100000:2.0:1784938231.459503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 168 00000100:00100000:2.0:1784938231.459508:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144191872:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.459532:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144191872:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.459538:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 168 00000100:00100000:2.0:1784938231.459547:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 169 00000100:00100000:2.0:1784938231.459552:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144192384:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.459569:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144192384:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 17us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.459574:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 169 00000100:00100000:2.0:1784938231.459583:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 170 00000100:00100000:2.0:1784938231.459588:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144191488:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.459602:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144191488:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 15us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.459608:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 170 00000100:00100000:2.0:1784938231.459623:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144192512 00000100:00100000:2.0:1784938231.459630:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144192512 00000100:00100000:2.0:1784938231.459652:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144192000 00000100:00100000:2.0:1784938231.459654:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144192000 00000100:00100000:2.0:1784938231.459670:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 67 00000100:00100000:2.0:1784938231.459676:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144192512:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.459702:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144192512:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.459708:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 67 00000100:00100000:2.0:1784938231.459719:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 68 00000100:00100000:2.0:1784938231.459725:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144192000:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.459748:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144192000:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938231.459753:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 68 00000100:00080000:2.0:1784938231.459771:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938231.459775:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938231.459777:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938231.460037:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144191488:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938231.460050:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfb2d5180 x1871643144192000/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938231.460061:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144192000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938231.460571:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144190976 00000100:00100000:3.0:1784938231.460576:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144190976 00000100:00100000:3.0:1784938231.460613:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 76 00000100:00100000:3.0:1784938231.460619:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144190976:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938231.460641:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938231.460679:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144190976:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 59us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938231.460698:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 76 00000100:00100000:3.0:1784938231.460725:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144191232:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938231.460767:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144191744:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938231.460790:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144192256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938231.460815:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1784938231.460822:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144191104:0@lo:400:kworker.0 00000100:00100000:3.0:1784938231.460854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938231.460884:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144191616:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938231.460909:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144192128:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938231.460929:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144192640:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938231.460961:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144191104 00000100:00100000:3.0:1784938231.460965:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144191104 00000100:00100000:3.0:1784938231.460990:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1784938231.460996:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144191104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938231.461034:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144191104:12345-0@lo:400:kworker.0 Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938231.461052:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:3.0:1784938231.461096:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938231.461569:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938231.461616:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938231.461631:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938231.461645:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938231.461659:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938231.461678:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938231.461698:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144191616 00000100:00100000:0.0:1784938231.461710:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144191616 00000100:00100000:0.0:1784938231.461739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 118 00000100:00100000:0.0:1784938231.461746:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144191616:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938231.461789:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144191616:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938231.461795:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 118 00000100:00100000:0.0:1784938231.461867:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144192256 00000100:00100000:0.0:1784938231.461871:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144192256 00000100:00100000:0.0:1784938231.461895:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144191232 00000100:00100000:0.0:1784938231.461898:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144191232 00000100:00100000:0.0:1784938231.461908:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144191744 00000100:00100000:0.0:1784938231.461910:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144191744 00000100:00100000:0.0:1784938231.461923:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 171 00000100:00100000:0.0:1784938231.461929:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144192256:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938231.461958:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144192256:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938231.461964:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 171 00000100:00100000:0.0:1784938231.461976:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 172 00000100:00100000:0.0:1784938231.461982:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0190aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144191232:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938231.462005:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0190aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144191232:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938231.462011:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 172 00000100:00100000:0.0:1784938231.462021:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 173 00000100:00100000:0.0:1784938231.462027:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144191744:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938231.462049:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144191744:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938231.462063:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 173 00000100:00080000:3.0:1784938231.462191:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938231.462201:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144192640 00000100:00100000:3.0:1784938231.462205:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144192640 00000100:00100000:3.0:1784938231.462246:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77 00000100:00100000:3.0:1784938231.462252:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144192640:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938231.462264:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938231.462389:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144192128 00000100:00100000:1.0:1784938231.462394:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144192128 00000100:00100000:1.0:1784938231.462428:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 69 00000100:00100000:1.0:1784938231.462435:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144192128:12345-192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938231.462509:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd5dd180 x1871643144192512/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938231.462523:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144192512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938231.462543:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144191360:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938231.462562:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfb2d4700 x1871643144191872/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938231.462571:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144191872:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938231.462580:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfb2d7b80 x1871643144192384/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938231.462589:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144192384:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938231.462645:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc76cd880 x1871643144190976/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938231.462659:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144190976:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938231.463276:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144192640:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 1020us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938231.463285:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77 00000100:00100000:3.0:1784938231.463454:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144191104:0@lo:400:kworker.0 00000100:00100000:3.0:1784938231.463466:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144191616:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938231.463477:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb56d80 x1871643144192640/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938231.463490:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144192640:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938231.463500:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144191232:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938231.463509:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144191744:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938231.463517:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144192256:192.168.203.126@tcp:400:kworker.0 00000100:00080000:3.0:1784938231.463668:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784938231.477918:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfb2d4380 x1871643144192128/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938231.477957:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144192128:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938231.478078:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144192128:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 14944us (15762us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938231.478092:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 69 00010000:00010000:0.0:1784938232.415594:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938232.480876:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144192768:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938232.480935:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938232.481137:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938232.481243:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144192768 00000100:00100000:0.0:1784938232.481251:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144192768 00000100:00100000:0.0:1784938232.481298:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 78 00000100:00100000:0.0:1784938232.481309:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144192768:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938232.481339:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938232.481393:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144192768:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938232.481400:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 78 00010000:00080000:1.0:1784938232.481670:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7dca80 x1871643144192768/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938232.481704:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144192768:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938232.482149:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144192896:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938232.482501:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938232.482705:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144192896 00000100:00100000:3.0:1784938232.482713:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144192896 00000100:00100000:3.0:1784938232.482765:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 79 00000100:00100000:3.0:1784938232.482774:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144192896:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938232.482795:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938232.490833:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144192896:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 8043us (8316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938232.490850:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 79 00010000:00080000:3.0:1784938232.491603:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb56d80 x1871643144192896/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938232.491624:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144192896:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:0.0:1784938233.439402:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938233.503459:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938233.503485:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144193024:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938233.503868:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938233.503986:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144193024 00000100:00100000:3.0:1784938233.503994:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144193024 00000100:00100000:3.0:1784938233.504049:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 119 00000100:00100000:3.0:1784938233.504070:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144193024:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938233.504103:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784938233.504149:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144193024:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 92us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938233.504156:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 119 00000100:00100000:3.0:1784938233.504327:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144193024:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938234.467835:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938235.041083:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144193152:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938235.041401:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938235.041470:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144193152 00000100:00100000:2.0:1784938235.041477:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144193152 00000100:00100000:2.0:1784938235.041523:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 120 00000100:00100000:2.0:1784938235.041531:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144193152:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:2.0:1784938235.041562:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784938235.041601:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144193152:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938235.041607:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 120 00000100:00100000:2.0:1784938235.041744:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144193152:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938235.487760:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938236.511662:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938236.551665:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938236.552029:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125236096 00000100:00100000:2.0:1784938236.552048:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125236096 00000100:00100000:2.0:1784938236.552107:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 314 00000100:00100000:2.0:1784938236.552117:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125236096:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938236.552191:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125236096:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 75us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938236.552199:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 314 00000100:00100000:0.0:1784938236.564268:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938236.564299:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938236.564321:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938236.564337:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938236.564353:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938236.564428:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938236.564459:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125236224 00000100:00100000:0.0:1784938236.564468:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125236224 00000100:00100000:0.0:1784938236.564517:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125236480 00000100:00100000:0.0:1784938236.564520:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125236480 00000100:00100000:0.0:1784938236.564533:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125236352 00000100:00100000:0.0:1784938236.564536:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125236352 00000100:00100000:0.0:1784938236.564561:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125236608 00000100:00100000:0.0:1784938236.564564:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125236608 00000100:00100000:0.0:1784938236.564579:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 174 00000100:00100000:0.0:1784938236.564588:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0190a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125236224:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.564663:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0190a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125236224:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 75us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.564671:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 174 00000100:00100000:0.0:1784938236.564686:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 175 00000100:00100000:0.0:1784938236.564692:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0190a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125236480:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.564715:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0190a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125236480:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.564721:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 175 00000100:00100000:0.0:1784938236.564732:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 176 00000100:00100000:0.0:1784938236.564737:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0190b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125236352:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.564758:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0190b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125236352:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.564764:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 176 00000100:00100000:0.0:1784938236.564774:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:0.0:1784938236.564780:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125236608:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.564800:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125236608:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 20us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.564805:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:0.0:1784938236.564826:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125236736 00000100:00100000:0.0:1784938236.564829:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125236736 00000100:00100000:0.0:1784938236.564862:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125236864 00000100:00100000:0.0:1784938236.564866:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125236864 00000100:00100000:0.0:1784938236.564884:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:0.0:1784938236.564891:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125236736:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.564917:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125236736:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.564923:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:0.0:1784938236.564934:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:0.0:1784938236.564941:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125236864:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.564964:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125236864:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.564969:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00080000:0.0:1784938236.564994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938236.564998:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938236.565000:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938236.565003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938236.575355:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938236.575378:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144193280:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938236.575636:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144193408:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938236.575841:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938236.575923:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938236.575946:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144193280 00000100:00100000:3.0:1784938236.575953:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144193280 00000100:00100000:3.0:1784938236.575996:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144193408 00000100:00100000:3.0:1784938236.575999:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144193408 00000100:00100000:3.0:1784938236.576017:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 80 00000100:00100000:3.0:1784938236.576025:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144193280:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938236.576066:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938236.576104:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144193280:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938236.576111:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 80 00000100:00100000:3.0:1784938236.576129:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 81 00000100:00100000:3.0:1784938236.576136:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144193408:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938236.576147:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938236.576167:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144193408:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938236.576173:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 81 00000100:00080000:3.0:1784938236.576192:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784938236.576438:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7df800 x1871643144193408/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938236.576456:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144193408:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00080000:3.0:1784938236.576498:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7dc000 x1871643144193280/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938236.576510:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144193280:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938236.576796:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144193664:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.576838:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144194176:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.576860:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144194688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.576901:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784938236.576907:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144193792:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.576928:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144194304:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.576950:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144194816:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.577092:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.577113:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.577130:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.577151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.577172:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.577190:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.577205:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144193664 00000100:00100000:0.0:1784938236.577209:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144193664 00000100:00100000:0.0:1784938236.577259:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144194176 00000100:00100000:0.0:1784938236.577263:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144194176 00000100:00100000:0.0:1784938236.577283:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144194688 00000100:00100000:0.0:1784938236.577285:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144194688 00000100:00100000:0.0:1784938236.577296:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144194304 00000100:00100000:0.0:1784938236.577298:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144194304 00000100:00100000:0.0:1784938236.577309:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144194816 00000100:00100000:0.0:1784938236.577312:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144194816 00000100:00100000:0.0:1784938236.577327:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 178 00000100:00100000:0.0:1784938236.577334:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144193664:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.577371:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144193664:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.577378:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 178 00000100:00100000:0.0:1784938236.577392:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 179 00000100:00100000:0.0:1784938236.577398:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144194176:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.577420:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144194176:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.577426:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 179 00000100:00100000:0.0:1784938236.577438:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 180 00000100:00100000:0.0:1784938236.577451:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144194688:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.577476:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144194688:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.577481:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 180 00000100:00100000:0.0:1784938236.577492:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 181 00000100:00100000:0.0:1784938236.577498:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144194304:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.577577:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144194304:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 78us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.577582:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 181 00000100:00100000:0.0:1784938236.577594:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 182 00000100:00100000:0.0:1784938236.577600:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144194816:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.577622:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144194816:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.577628:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 182 00000100:00100000:0.0:1784938236.577651:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144193792 00000100:00100000:0.0:1784938236.577654:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144193792 00000100:00100000:0.0:1784938236.577679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 121 00000100:00100000:0.0:1784938236.577685:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144193792:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.577711:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144193792:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.577717:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 121 00000100:00080000:0.0:1784938236.577737:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938236.577741:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938236.578140:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144193920:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938236.578182:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144194432:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938236.578208:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784938236.578234:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d0190ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144193536:0@lo:400:kworker.0 00000100:00100000:2.0:1784938236.578269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938236.578296:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144194048:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938236.578323:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144194560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938236.578610:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144193536 00000100:00100000:3.0:1784938236.578616:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144193536 00000100:00100000:0.0:1784938236.578842:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.578870:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.578903:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.578924:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938236.578942:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144194432 00000100:00100000:0.0:1784938236.578946:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144194432 00000100:00100000:0.0:1784938236.578974:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144194560 00000100:00100000:0.0:1784938236.578978:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144194560 00000100:00100000:0.0:1784938236.578997:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 72 00000100:00100000:0.0:1784938236.579004:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144194432:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938236.579115:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784938236.579125:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144193536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938236.579170:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144193536:12345-0@lo:400:kworker.0 Request processed in 47us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938236.579177:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1784938236.579241:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144194432:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 236us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.579248:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 72 00000100:00100000:0.0:1784938236.579261:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 73 00000100:00100000:0.0:1784938236.579267:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144194560:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.579291:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144194560:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.579296:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 73 00000100:00100000:0.0:1784938236.579315:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144194048 00000100:00100000:0.0:1784938236.579318:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144194048 00000100:00100000:0.0:1784938236.579340:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 122 00000100:00100000:0.0:1784938236.579346:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144194048:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.579371:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144194048:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.579377:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 122 00000100:00080000:0.0:1784938236.579400:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938236.579436:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144193792:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938236.579451:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb15c00 x1871643144194304/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938236.579469:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144194304:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938236.579484:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb17100 x1871643144194816/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938236.579493:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144194816:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.579506:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144193664:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.579516:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144194176:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.579525:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144194688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.579557:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144193920 00000100:00100000:0.0:1784938236.579561:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144193920 00000100:00100000:0.0:1784938236.579585:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 183 00000100:00100000:0.0:1784938236.579592:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144193920:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938236.579620:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144193920:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938236.579626:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 183 00000100:00100000:3.0:1784938236.587426:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d0190ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144193536:0@lo:400:kworker.0 00000100:00100000:3.0:1784938236.587450:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144194048:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938236.587466:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb17b80 x1871643144194560/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938236.587479:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144194560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938236.587492:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144193920:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938236.587504:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb14700 x1871643144194432/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938236.587512:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144194432:192.168.203.126@tcp:400:kworker.0 00010000:00010000:1.0:1784938237.535576:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938237.599584:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144194944:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938237.600370:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938237.600383:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144195072:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938237.610446:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938237.611711:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938237.611854:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144194944 00000100:00100000:3.0:1784938237.611876:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144194944 00000100:00100000:3.0:1784938237.611928:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144195072 00000100:00100000:3.0:1784938237.611930:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144195072 00000100:00100000:3.0:1784938237.611947:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00100000:3.0:1784938237.611957:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144194944:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938237.612001:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938237.612341:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144194944:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 384us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938237.612350:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00100000:3.0:1784938237.612373:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 83 00000100:00100000:3.0:1784938237.612381:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144195072:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938237.612394:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938237.632402:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144195072:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 20002us (21832us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938237.632421:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 83 00010000:00080000:1.0:1784938237.633530:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d82300 x1871643144195072/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938237.633564:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144195072:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00080000:1.0:1784938237.633586:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb57100 x1871643144194944/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938237.633599:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144194944:192.168.203.126@tcp:13:osp-pre-0-0.0 00000020:00000004:2.0:1784938238.058000:0:12500:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938238.060517:0:12500:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784938238.559489:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938238.625188:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938238.625242:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144195200:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938238.625779:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938238.625815:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144195200 00000100:00100000:0.0:1784938238.625826:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144195200 00000100:00100000:0.0:1784938238.625895:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 123 00000100:00100000:0.0:1784938238.625907:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144195200:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938238.625971:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938238.626043:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144195200:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 138us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938238.626051:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 123 00000100:00100000:1.0:1784938238.626382:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144195200:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938239.583410:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938240.159468:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938240.159500:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144195328:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938240.159982:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938240.160093:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144195328 00000100:00100000:0.0:1784938240.160103:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144195328 00000100:00100000:0.0:1784938240.160175:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 124 00000100:00100000:0.0:1784938240.160189:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144195328:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938240.160633:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938240.160710:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144195328:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 525us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938240.160720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 124 00000100:00100000:2.0:1784938240.161087:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144195328:192.168.203.126@tcp:41:osp-pre-1-0.0 00000020:00000004:1.0:1784938240.509859:0:12597:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938240.510126:0:12597:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784938240.607490:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938241.631450:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938241.660538:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938241.660583:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938241.660626:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938241.660657:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938241.660681:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938241.660700:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938241.660724:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938241.660753:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125237632 00000100:00100000:3.0:1784938241.660762:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125237632 00000100:00100000:3.0:1784938241.660829:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125237760 00000100:00100000:3.0:1784938241.660833:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125237760 00000100:00100000:1.0:1784938241.660947:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125237248 00000100:00100000:1.0:1784938241.660951:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125237248 00000100:00100000:1.0:1784938241.660987:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125237504 00000100:00100000:1.0:1784938241.660990:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125237504 00000100:00100000:1.0:1784938241.661018:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125237120 00000100:00100000:1.0:1784938241.661021:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125237120 00000100:00100000:1.0:1784938241.661033:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125237376 00000100:00100000:1.0:1784938241.661035:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125237376 00000100:00100000:3.0:1784938241.661104:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1784938241.661157:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125236992 00000100:00100000:0.0:1784938241.661162:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125236992 00000100:00100000:1.0:1784938241.661915:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:1.0:1784938241.661941:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125237248:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.662047:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125237248:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 122us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938241.662055:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:1.0:1784938241.662080:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:1.0:1784938241.662087:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125237504:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.662113:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125237504:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938241.662120:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:1.0:1784938241.662132:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:1.0:1784938241.662139:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125237120:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.662161:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125237120:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938241.662166:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:1.0:1784938241.662176:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:1.0:1784938241.662182:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125237376:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.662204:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125237376:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938241.662209:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:3.0:1784938241.662437:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2391:x1871643125237632:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:3.0:1784938241.662460:0:8770:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee39a 00000100:00080000:3.0:1784938241.662470:0:8770:0:(import.c:65:import_set_state_nolock()) ffff910bc7cbd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938241.662539:0:8770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1784938241.662680:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+2:2391:x1871643125237632:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 1565us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938241.662729:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 316 00000100:00100000:0.0:1784938241.662743:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125236992:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938241.662770:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125236992:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 33us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938241.662776:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 316 00010000:00010000:1.0:1784938241.662918:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938241.663382:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1784938241.663395:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2391:x1871643125237760:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:2.0:1784938241.663412:0:8430:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee3a1 00000100:00080000:2.0:1784938241.663431:0:8430:0:(import.c:65:import_set_state_nolock()) ffff910cffbc8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938241.663512:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1784938241.663756:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+2:2391:x1871643125237760:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 364us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938241.663809:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00010000:00010000:1.0:1784938241.664144:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938241.664205:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938241.664210:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938241.664230:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938241.664233:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938241.664290:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1784938241.695604:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938241.695645:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144195456:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938241.696295:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144195584:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938241.696565:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938241.696666:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938241.696701:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144195456 00000100:00100000:3.0:1784938241.696711:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144195456 00000100:00100000:3.0:1784938241.696772:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144195584 00000100:00100000:3.0:1784938241.696775:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144195584 00000100:00100000:3.0:1784938241.696796:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:3.0:1784938241.696806:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144195456:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938241.696843:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938241.696889:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144195456:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938241.696897:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:3.0:1784938241.696917:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00100000:3.0:1784938241.696924:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144195584:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938241.696934:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938241.696977:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144195584:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 53us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938241.696983:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00080000:3.0:1784938241.697135:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784938241.697174:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb74e00 x1871643144195584/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938241.697201:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144195584:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00080000:3.0:1784938241.697245:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7de680 x1871643144195456/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938241.697258:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144195456:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938241.700366:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144195968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938241.700367:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144195712:0@lo:400:kworker.0 00000100:00100000:0.0:1784938241.700485:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144195840:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938241.701751:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144196480:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938241.709267:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144196352:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938241.709346:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144196864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938241.710029:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938241.710281:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938241.710308:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938241.710330:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938241.710364:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144195968 00000100:00100000:0.0:1784938241.710376:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144195968 00000100:00100000:0.0:1784938241.710442:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 125 00000100:00100000:0.0:1784938241.710453:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144195968:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938241.710536:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144195968:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 84us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938241.710544:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 125 00000100:00100000:0.0:1784938241.710575:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144195840 00000100:00100000:0.0:1784938241.710579:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144195840 00000100:00100000:0.0:1784938241.710604:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144196352 00000100:00100000:0.0:1784938241.710607:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144196352 00000100:00100000:0.0:1784938241.710634:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144196864 00000100:00100000:0.0:1784938241.710638:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144196864 00000100:00100000:0.0:1784938241.710654:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 188 00000100:00100000:0.0:1784938241.710660:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144195840:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938241.711178:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144195840:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 515us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938241.711187:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 188 00000100:00100000:0.0:1784938241.711207:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 189 00000100:00100000:0.0:1784938241.711236:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144196352:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938241.711290:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144196352:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 77us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938241.711298:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 189 00000100:00100000:0.0:1784938241.711311:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 190 00000100:00100000:0.0:1784938241.711317:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144196864:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938241.711341:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144196864:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938241.711347:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 190 00000100:00100000:3.0:1784938241.713271:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144196992:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938241.713328:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938241.713335:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144196096:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938241.713367:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144196608:192.168.203.126@tcp:400:kworker.0 00000100:00080000:3.0:1784938241.713407:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938241.717109:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938241.718015:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144195712 00000100:00100000:3.0:1784938241.718032:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144195712 00000100:00100000:3.0:1784938241.718117:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1784938241.718129:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144195712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938241.718434:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144195712:12345-0@lo:400:kworker.0 Request processed in 306us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938241.718792:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1784938241.719298:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144195840:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.719358:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144196352:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.719391:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144196864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.719435:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938241.719477:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144196480 00000100:00100000:1.0:1784938241.719483:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144196480 00000100:00100000:1.0:1784938241.719530:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 191 00000100:00100000:1.0:1784938241.719537:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144196480:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938241.719644:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144196224:192.168.203.126@tcp:400:kworker.0 00000100:00080000:3.0:1784938241.719778:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938241.719805:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144195968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938241.724940:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938241.725065:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938241.725211:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938241.725299:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938241.725336:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144196224 00000100:00100000:0.0:1784938241.725347:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144196224 00000100:00100000:0.0:1784938241.725407:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 126 00000100:00100000:0.0:1784938241.725419:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144196224:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.725674:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144196480:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 6123us (6225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938241.725687:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 191 00000100:00100000:1.0:1784938241.725714:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144196992 00000100:00100000:1.0:1784938241.725718:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144196992 00000100:00100000:1.0:1784938241.725751:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144196096 00000100:00100000:1.0:1784938241.725755:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144196096 00000100:00100000:1.0:1784938241.725769:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 192 00000100:00100000:1.0:1784938241.725776:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144196992:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.725858:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144196992:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 82us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938241.725864:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 192 00000100:00100000:1.0:1784938241.725878:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 193 00000100:00100000:1.0:1784938241.725884:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144196096:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938241.725912:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144196096:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938241.725918:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 193 00000100:00080000:3.0:1784938241.726201:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938241.726285:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144196096:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938241.726308:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb76d80 x1871643144196480/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938241.726320:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144196480:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938241.726331:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd730000 x1871643144196992/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938241.726340:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144196992:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938241.726379:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144196608 00000100:00100000:3.0:1784938241.726382:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144196608 00000100:00100000:3.0:1784938241.726426:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 74 00000100:00100000:3.0:1784938241.726433:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144196608:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938241.726490:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144196608:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 57us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938241.726496:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 74 00010000:00080000:3.0:1784938241.726628:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd733480 x1871643144196608/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938241.726638:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144196608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938241.726858:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144196736:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938241.726985:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144195712:0@lo:400:kworker.0 00000100:00100000:0.0:1784938241.728061:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144196224:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 2638us (2754us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938241.728076:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 126 00000100:00100000:0.0:1784938241.728719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938241.728877:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144196736 00000100:00100000:2.0:1784938241.728885:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144196736 00000100:00100000:2.0:1784938241.728938:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 75 00000100:00100000:2.0:1784938241.728947:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144196736:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938241.728995:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144196736:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 49us (280us total) trans 0 rc 0/0 00000100:00080000:1.0:1784938241.730300:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938241.730410:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 75 00000100:00100000:2.0:1784938241.730475:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144196224:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938241.730494:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731c00 x1871643144196736/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938241.730517:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144196736:192.168.203.126@tcp:400:kworker.0 00010000:00010000:0.0:1784938242.656733:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938242.725021:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144197120:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938242.727902:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938242.728504:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144197120 00000100:00100000:1.0:1784938242.728519:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144197120 00000100:00100000:1.0:1784938242.728833:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 86 00000100:00100000:1.0:1784938242.728847:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144197120:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938242.728898:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938242.729187:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144197120:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 341us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938242.729196:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 86 00000100:00100000:2.0:1784938242.730524:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144197248:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938242.731016:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938242.731312:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144197248 00000100:00100000:2.0:1784938242.731322:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144197248 00000100:00100000:3.0:1784938242.731394:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 87 00000100:00100000:3.0:1784938242.731419:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144197248:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938242.731464:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938242.731526:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144197248:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 110us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938242.731536:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 87 00010000:00080000:3.0:1784938242.732180:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb17100 x1871643144197248/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938242.732208:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144197248:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00080000:1.0:1784938242.733004:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb74a80 x1871643144197120/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938242.733027:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144197120:192.168.203.126@tcp:13:osp-pre-0-1.0 00000020:00000004:2.0:1784938242.790603:0:12694:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938242.790837:0:12694:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784938243.679458:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938243.743363:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144197376:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938243.743624:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938243.743653:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144197376 00000100:00100000:1.0:1784938243.743662:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144197376 00000100:00100000:1.0:1784938243.743710:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 127 00000100:00100000:1.0:1784938243.743719:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144197376:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:1.0:1784938243.743750:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784938243.743794:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144197376:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 75us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938243.743801:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 127 00000100:00100000:1.0:1784938243.743938:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144197376:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938244.703511:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938245.280014:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144197504:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938245.280355:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938245.280447:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144197504 00000100:00100000:0.0:1784938245.280456:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144197504 00000100:00100000:0.0:1784938245.280510:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 128 00000100:00100000:0.0:1784938245.280519:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144197504:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938245.280558:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938245.280602:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144197504:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 83us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938245.280610:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 128 00000100:00100000:2.0:1784938245.281791:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144197504:192.168.203.126@tcp:41:osp-pre-1-0.0 00000020:00000004:1.0:1784938245.284761:0:12792:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938245.285065:0:12792:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784938245.727868:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938246.758479:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938246.784988:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938246.785035:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938246.785055:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938246.785075:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938246.785099:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938246.785125:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125238144 00000100:00100000:1.0:1784938246.785134:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125238144 00000100:00100000:1.0:1784938246.785181:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125238400 00000100:00100000:1.0:1784938246.785184:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125238400 00000100:00100000:1.0:1784938246.785197:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125238016 00000100:00100000:1.0:1784938246.785200:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125238016 00000100:00100000:1.0:1784938246.785209:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125238272 00000100:00100000:1.0:1784938246.785231:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125238272 00000100:00100000:1.0:1784938246.785251:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:1.0:1784938246.785260:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125238144:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938246.785329:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125238144:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938246.785337:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:1.0:1784938246.785355:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:1.0:1784938246.785361:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125238400:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938246.785387:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125238400:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938246.785393:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:1.0:1784938246.785404:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:1.0:1784938246.785409:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125238016:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938246.785448:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125238016:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 38us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938246.785454:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:1.0:1784938246.785467:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:1.0:1784938246.785473:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125238272:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938246.785497:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125238272:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938246.785503:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00080000:1.0:1784938246.785522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938246.785525:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938246.790586:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125237888 00000100:00100000:3.0:1784938246.790601:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125237888 00000100:00100000:3.0:1784938246.792267:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 318 00000100:00100000:3.0:1784938246.792285:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2394:x1871643125237888:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.792496:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2394:x1871643125237888:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 216us (7528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.792504:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 318 00000100:00100000:3.0:1784938246.820010:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144197760:0@lo:400:kworker.0 00000100:00100000:3.0:1784938246.820075:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938246.820132:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144198272:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.820183:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144198784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.820233:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144199296:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.820264:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784938246.820276:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144197888:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.820311:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144198400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.820330:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144198912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.820363:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144197760 00000100:00100000:3.0:1784938246.820369:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144197760 00000100:00100000:3.0:1784938246.820407:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784938246.820426:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144197760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938246.820475:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144197760:12345-0@lo:400:kworker.0 Request processed in 61us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.820482:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784938246.820671:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.820740:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.820762:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.820785:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.820809:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.820832:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.820856:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144198272 00000100:00100000:3.0:1784938246.820859:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144198272 00000100:00100000:3.0:1784938246.820889:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 129 00000100:00100000:3.0:1784938246.820895:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144198272:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.820934:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144198272:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 39us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.820941:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 129 00000100:00100000:3.0:1784938246.820960:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144198784 00000100:00100000:3.0:1784938246.820963:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144198784 00000100:00100000:3.0:1784938246.821017:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144199296 00000100:00100000:3.0:1784938246.821021:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144199296 00000100:00100000:3.0:1784938246.821061:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 76 00000100:00100000:3.0:1784938246.821068:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144198784:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.821098:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144198784:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.821103:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 76 00000100:00100000:3.0:1784938246.821115:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77 00000100:00100000:3.0:1784938246.821120:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144199296:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.821140:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144199296:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.821145:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77 00000100:00100000:3.0:1784938246.821163:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144197888 00000100:00100000:3.0:1784938246.821166:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144197888 00000100:00100000:3.0:1784938246.821186:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144198400 00000100:00100000:3.0:1784938246.821188:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144198400 00000100:00100000:3.0:1784938246.821199:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144198912 00000100:00100000:3.0:1784938246.821201:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144198912 00000100:00100000:3.0:1784938246.821238:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 198 00000100:00100000:3.0:1784938246.821244:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144197888:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.821269:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144197888:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.821274:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 198 00000100:00100000:3.0:1784938246.821288:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 199 00000100:00100000:3.0:1784938246.821294:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144198400:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.821316:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144198400:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.821327:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 199 00000100:00100000:3.0:1784938246.821339:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 200 00000100:00100000:3.0:1784938246.821345:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144198912:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.821368:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144198912:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.821374:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 200 00000100:00080000:3.0:1784938246.821394:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938246.821398:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938246.821400:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938246.821573:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144197888:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.821584:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144198400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.821591:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144198912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.821599:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144197760:0@lo:400:kworker.0 00000100:00100000:3.0:1784938246.821607:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144198272:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938246.821618:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd732d80 x1871643144198784/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938246.821628:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144198784:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938246.821637:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd733800 x1871643144199296/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938246.821645:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144199296:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938246.827336:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144197632:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938246.827440:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144198144:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938246.827469:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144198656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938246.827490:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144199168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938246.827517:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784938246.827525:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144198016:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938246.827551:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144198528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938246.827572:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144199040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.835010:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.835057:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.835079:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938246.835428:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144198656 00000100:00100000:2.0:1784938246.835437:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144198656 00000100:00100000:2.0:1784938246.835728:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 78 00000100:00100000:2.0:1784938246.835740:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144198656:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938246.835815:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144198656:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 76us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938246.835823:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 78 00010000:00080000:2.0:1784938246.836008:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd733100 x1871643144198656/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938246.836025:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144198656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.836501:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.836531:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.836556:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.836580:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938246.836603:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144197632 00000100:00100000:3.0:1784938246.836610:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144197632 00000100:00100000:3.0:1784938246.836648:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 88 00000100:00100000:3.0:1784938246.836657:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144197632:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938246.836683:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938246.836725:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144197632:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 69us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.836732:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 88 00000100:00100000:3.0:1784938246.836751:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144199168 00000100:00100000:3.0:1784938246.836756:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144199168 00000100:00100000:3.0:1784938246.836780:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 79 00000100:00100000:3.0:1784938246.836788:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144199168:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.836816:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144199168:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.836822:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 79 00000100:00100000:3.0:1784938246.836839:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144198016 00000100:00100000:3.0:1784938246.836843:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144198016 00000100:00100000:3.0:1784938246.836865:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 130 00000100:00100000:3.0:1784938246.836871:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144198016:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.836900:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144198016:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.836916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 130 00000100:00100000:3.0:1784938246.836935:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144198144 00000100:00100000:3.0:1784938246.836939:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144198144 00000100:00100000:3.0:1784938246.836959:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144198528 00000100:00100000:3.0:1784938246.836962:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144198528 00000001:00100000:0.0:1784938246.840323:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000020:00000080:0.0:1784938246.840334:0:8424:0:(genops.c:906:class_export_put()) final put ffff910bc7cb8000/2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000100:00100000:3.0:1784938246.840910:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144199040 00000100:00100000:3.0:1784938246.840920:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144199040 00000100:00100000:3.0:1784938246.840945:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 201 00000100:00100000:3.0:1784938246.840955:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144198144:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.841040:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144198144:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 85us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.841048:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 201 00000100:00100000:3.0:1784938246.841066:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 202 00000100:00100000:3.0:1784938246.841073:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144198528:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.841185:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144198528:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 111us (4627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.841192:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 202 00000100:00100000:3.0:1784938246.841206:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 203 00000100:00100000:3.0:1784938246.841231:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144199040:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938246.841265:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144199040:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 52us (4683us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938246.841271:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 203 00000020:00000080:2.0:1784938246.841408:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7cb8000/2e0e55a1-2fc4-4192-a43b-67b180b29a8a for lustre-OST0000 00000020:00000080:2.0:1784938246.841447:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc7cbd800 for lustre-OST0000 00000100:00100000:2.0:1784938246.841866:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144198016:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938246.841882:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd732300 x1871643144198528/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938246.841892:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144198528:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938246.841917:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731880 x1871643144199040/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938246.841926:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144199040:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938246.841936:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd733480 x1871643144197632/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938246.841950:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144197632:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938246.841960:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144198144:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938246.841978:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731c00 x1871643144199168/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938246.841985:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144199168:192.168.203.126@tcp:400:kworker.0 00000100:00080000:2.0:1784938246.845535:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938246.845546:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938246.845549:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938246.845643:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144199424:192.168.203.126@tcp:13:osp-pre-1-0.0 00000001:00100000:3.0:1784938246.848665:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000020:00000080:3.0:1784938246.848683:0:9509:0:(genops.c:906:class_export_put()) final put ffff910cffbca800/2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000020:00000080:0.0:1784938246.848762:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff910cffbca800/2e0e55a1-2fc4-4192-a43b-67b180b29a8a for lustre-OST0001 00000020:00000080:0.0:1784938246.848814:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cffbc8000 for lustre-OST0001 00000100:00100000:2.0:1784938246.850089:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938246.850167:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144199424 00000100:00100000:0.0:1784938246.850175:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144199424 00000100:00100000:0.0:1784938246.850235:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 89 00000100:00100000:0.0:1784938246.850245:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144199424:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938246.850269:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938246.856261:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144199424:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 6005us (6166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938246.856276:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 89 00010000:00080000:0.0:1784938246.859749:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb17100 x1871643144199424/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938246.859775:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144199424:192.168.203.126@tcp:13:osp-pre-1-0.0 00000020:00000004:1.0:1784938247.605611:0:12889:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938247.605938:0:12889:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784938247.776053:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938247.840306:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938247.840345:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144199552:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938247.840835:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938247.841591:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144199552 00000100:00100000:0.0:1784938247.841604:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144199552 00000100:00100000:0.0:1784938247.841676:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 90 00000100:00100000:0.0:1784938247.841686:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144199552:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938247.841729:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938247.841803:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144199552:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 118us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938247.841811:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 90 00000100:00100000:0.0:1784938247.841881:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938247.841895:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144199680:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938247.842203:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:0.0:1784938247.842280:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb76a00 x1871643144199552/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938247.842304:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144199552:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938247.842331:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144199680 00000100:00100000:0.0:1784938247.842335:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144199680 00000100:00100000:0.0:1784938247.842375:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 91 00000100:00100000:0.0:1784938247.842381:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0190ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144199680:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938247.842395:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938247.842423:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0190ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144199680:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 42us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938247.842430:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 91 00010000:00080000:0.0:1784938247.842514:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb17100 x1871643144199680/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938247.842526:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144199680:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:0.0:1784938248.800677:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938248.863447:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938248.863468:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144199808:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938248.863870:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938248.864043:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144199808 00000100:00100000:2.0:1784938248.864051:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144199808 00000100:00100000:2.0:1784938248.864101:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 131 00000100:00100000:2.0:1784938248.864110:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144199808:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938248.864143:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784938248.864191:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144199808:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 81us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938248.864208:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 131 00000100:00100000:2.0:1784938248.864927:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144199808:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:2.0:1784938249.823397:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938250.400966:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144199936:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938250.401913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938250.407172:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144199936 00000100:00100000:3.0:1784938250.407188:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144199936 00000100:00100000:3.0:1784938250.407292:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 132 00000100:00100000:3.0:1784938250.407303:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144199936:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938250.407342:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784938250.407601:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144199936:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 299us (5689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938250.407609:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 132 00000100:00100000:2.0:1784938250.408271:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144199936:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:1.0:1784938250.847605:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784938251.785828:0:13034:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1784938251.871523:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938251.905318:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938251.905353:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938251.905382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938251.905419:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938251.905446:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938251.905471:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125238784 00000100:00100000:0.0:1784938251.905480:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125238784 00000100:00100000:0.0:1784938251.905529:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125239040 00000100:00100000:0.0:1784938251.905533:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125239040 00000100:00100000:0.0:1784938251.905546:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125238656 00000100:00100000:0.0:1784938251.905548:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125238656 00000100:00100000:0.0:1784938251.905561:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125238912 00000100:00100000:0.0:1784938251.905563:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125238912 00000100:00100000:0.0:1784938251.905579:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:0.0:1784938251.905588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125238784:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938251.905668:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125238784:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 81us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938251.905683:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:0.0:1784938251.905701:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:0.0:1784938251.905707:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125239040:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938251.905735:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125239040:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938251.905741:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:0.0:1784938251.905753:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 206 00000100:00100000:0.0:1784938251.905759:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2393:x1871643125238656:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938251.905782:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2393:x1871643125238656:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938251.905789:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 206 00000100:00100000:0.0:1784938251.905801:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00100000:0.0:1784938251.905807:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125238912:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938251.905832:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125238912:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938251.905837:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00080000:0.0:1784938251.905857:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938251.905860:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938251.905998:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125238528 00000100:00100000:3.0:1784938251.906003:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125238528 00000100:00100000:3.0:1784938251.906032:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 320 00000100:00100000:3.0:1784938251.906038:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125238528:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.906063:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125238528:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938251.906070:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 320 00000100:00100000:2.0:1784938251.935367:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144200064:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938251.935613:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144200320:0@lo:400:kworker.0 00000100:00100000:3.0:1784938251.935672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938251.935717:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144200832:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.935770:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144201344:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.935801:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144201856:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.935830:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784938251.935836:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144200448:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.935859:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144200960:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.935895:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144201472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938251.936021:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144200576:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938251.936042:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144201088:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938251.936471:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144201600:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938251.936498:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1784938251.936504:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144200192:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938251.936518:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144200704:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938251.936532:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144201216:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938251.936547:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144201728:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938251.940369:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.940666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.940692:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.940715:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.940736:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.940755:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.940773:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.940791:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.940990:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.941018:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.941051:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.941072:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.941108:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.941142:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144200320 00000100:00100000:1.0:1784938251.941151:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144200320 00000100:00100000:1.0:1784938251.941199:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1784938251.941208:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144200320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938251.941581:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144201344 00000100:00100000:3.0:1784938251.941585:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144201344 00000100:00100000:3.0:1784938251.941616:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144201856 00000100:00100000:3.0:1784938251.941620:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144201856 00000100:00100000:3.0:1784938251.941632:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144201216 00000100:00100000:3.0:1784938251.941634:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144201216 00000100:00100000:3.0:1784938251.941646:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144201728 00000100:00100000:3.0:1784938251.941649:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144201728 00000100:00100000:3.0:1784938251.941661:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 80 00000100:00100000:3.0:1784938251.941668:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144201344:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.941704:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144201344:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 36us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938251.941711:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 80 00000100:00100000:3.0:1784938251.941728:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 81 00000100:00100000:3.0:1784938251.941734:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144201856:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.941756:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144201856:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938251.941762:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 81 00000100:00100000:3.0:1784938251.941772:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00100000:3.0:1784938251.941777:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144201216:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.941796:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144201216:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938251.941802:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00100000:3.0:1784938251.941811:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 83 00000100:00100000:1.0:1784938251.942019:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144200320:12345-0@lo:400:kworker.0 Request processed in 812us (6346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938251.942026:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1784938251.942144:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938251.943474:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144200448 00000100:00100000:1.0:1784938251.943485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144200448 00000100:00100000:1.0:1784938251.943517:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144200960 00000100:00100000:1.0:1784938251.943520:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144200960 00000100:00100000:1.0:1784938251.943535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144201088 00000100:00100000:1.0:1784938251.943537:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144201088 00000100:00100000:1.0:1784938251.943548:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144201600 00000100:00100000:1.0:1784938251.943551:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144201600 00000100:00100000:1.0:1784938251.943560:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144200704 00000100:00100000:1.0:1784938251.943563:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144200704 00000100:00100000:1.0:1784938251.943573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144201472 00000100:00100000:1.0:1784938251.943575:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144201472 00000100:00100000:1.0:1784938251.943591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 208 00000100:00100000:1.0:1784938251.943599:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144200448:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938251.943661:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144200448:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 63us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938251.943667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 208 00000100:00100000:1.0:1784938251.943684:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 209 00000100:00100000:1.0:1784938251.943697:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144200960:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938251.943722:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144200960:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938251.943728:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 209 00000100:00100000:1.0:1784938251.943741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 210 00000100:00100000:1.0:1784938251.943747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144201088:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938251.943767:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144201088:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938251.943772:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 210 00000100:00100000:1.0:1784938251.943782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 211 00000100:00100000:1.0:1784938251.943786:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144201600:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938251.943804:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144201600:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938251.943809:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 211 00000100:00100000:1.0:1784938251.943832:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 212 00000100:00100000:1.0:1784938251.943839:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144200704:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938251.943860:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144200704:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938251.943866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 212 00000100:00100000:1.0:1784938251.943877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 213 00000100:00100000:1.0:1784938251.943882:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144201472:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938251.943902:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144201472:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938251.943916:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 213 00000100:00100000:1.0:1784938251.943948:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144200064 00000100:00100000:1.0:1784938251.943952:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144200064 00000100:00100000:1.0:1784938251.943967:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144200192 00000100:00100000:1.0:1784938251.943969:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144200192 00000100:00100000:1.0:1784938251.943979:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 92 00000100:00100000:1.0:1784938251.943985:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144200064:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938251.944006:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938251.944032:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144200064:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 48us (3296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938251.944038:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 92 00000100:00100000:1.0:1784938251.944048:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 93 00000100:00100000:1.0:1784938251.944054:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144200192:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938251.944062:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938251.944078:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144200192:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 25us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938251.944083:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 93 00000100:00100000:3.0:1784938251.944499:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144201728:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.945479:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144201728:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 978us (4364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938251.945488:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 83 00000100:00100000:3.0:1784938251.945529:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144200832 00000100:00100000:3.0:1784938251.945536:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144200832 00000100:00100000:3.0:1784938251.945570:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144200576 00000100:00100000:3.0:1784938251.945573:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144200576 00000100:00100000:3.0:1784938251.945587:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 133 00000100:00100000:3.0:1784938251.945594:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144200832:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.945623:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144200832:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 30us (4958us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938251.945629:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 133 00000100:00100000:3.0:1784938251.945641:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 134 00000100:00100000:3.0:1784938251.945658:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144200576:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.945681:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144200576:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 34us (4888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938251.945687:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 134 00000100:00080000:3.0:1784938251.945721:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938251.945725:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938251.945729:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938251.945731:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938251.945851:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144200320:0@lo:400:kworker.0 00010000:00080000:3.0:1784938251.945868:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731880 x1871643144201344/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938251.945893:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144201344:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938251.945907:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77eb100 x1871643144201856/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938251.945916:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144201856:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938251.947979:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd732d80 x1871643144200192/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938251.948006:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144200192:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938251.948020:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144200704:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938251.948041:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd733480 x1871643144201216/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938251.948051:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144201216:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938251.948062:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77e9180 x1871643144201728/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938251.948072:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144201728:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938251.948083:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144200576:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938251.948095:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd730e00 x1871643144201088/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938251.948104:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144201088:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938251.948115:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd733b80 x1871643144201600/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938251.948123:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144201600:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938251.948134:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7df800 x1871643144200064/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938251.948146:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144200064:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938251.950608:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144200448:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.950627:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144200960:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.950639:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144201472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938251.950650:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144200832:192.168.203.126@tcp:400:kworker.0 00010000:00010000:2.0:1784938252.895902:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938252.960006:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938252.960032:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144202112:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938252.960391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938252.960419:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144202112 00000100:00100000:1.0:1784938252.960426:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144202112 00000100:00100000:1.0:1784938252.960467:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 94 00000100:00100000:1.0:1784938252.960476:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144202112:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938252.960504:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938252.960542:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144202112:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 68us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938252.960565:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 94 00000100:00100000:3.0:1784938252.960960:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144201984:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938252.961143:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:2.0:1784938252.961272:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7df800 x1871643144202112/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938252.961305:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144202112:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938252.965742:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144201984 00000100:00100000:1.0:1784938252.965756:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144201984 00000100:00100000:1.0:1784938252.965829:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 95 00000100:00100000:1.0:1784938252.965839:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144201984:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938252.965863:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938252.965959:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144201984:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 121us (4815us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938252.965966:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 95 00010000:00080000:1.0:1784938252.966183:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb66a00 x1871643144201984/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938252.966204:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144201984:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00010000:0.0:1784938253.919572:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938253.984724:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938253.987409:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144202240:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938253.987789:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938253.988578:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144202240 00000100:00100000:3.0:1784938253.988592:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144202240 00000100:00100000:3.0:1784938253.988669:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 135 00000100:00100000:3.0:1784938253.988681:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144202240:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938253.988725:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784938253.989347:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144202240:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 663us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938253.989357:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 135 00000100:00100000:3.0:1784938253.993104:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144202240:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938254.943468:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938255.519551:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144202368:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938255.525393:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938255.531260:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144202368 00000100:00100000:3.0:1784938255.531274:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144202368 00000100:00100000:3.0:1784938255.531383:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 136 00000100:00100000:3.0:1784938255.531394:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144202368:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938255.531431:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784938255.531515:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144202368:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 122us (6130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938255.531522:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 136 00000100:00100000:1.0:1784938255.531806:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144202368:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:2.0:1784938255.967573:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784938256.460400:0:13181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecdcefa20 20000000:00000080:2.0:1784938256.460427:0:13181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910cffb1dc00 uarg=0000000000000000 20000000:01000000:2.0:1784938256.460483:0:13181:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784938256.460490:0:13181:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784938256.460495:0:13181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784938256.470264:0:13182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1784938256.470573:0:13181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784938256.492097:0:13181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784938256.492308:0:13181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492357:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28575 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492366:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee33f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492374:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee34d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492381:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee35b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492388:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee369 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492395:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285b4 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492404:0:13181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492460:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285b4 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492480:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285b4 expref: 12 pid: 6505 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938256.492500:0:13181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144202496:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938256.492641:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee369 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492657:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee369 expref: 23 pid: 6506 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938256.492669:0:13181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144202624:0@lo:104: 00000100:00100000:0.0:1784938256.492723:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938256.492767:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee35b expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.492777:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee35b expref: 23 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938256.492785:0:13181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144202752:0@lo:104: 00000100:00100000:0.0:1784938256.492810:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938256.492846:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144202624 00000100:00100000:0.0:1784938256.492855:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144202624 00000100:00100000:0.0:1784938256.492918:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144202752 00000100:00100000:0.0:1784938256.492921:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144202752 00000100:00100000:0.0:1784938256.492940:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784938256.492949:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:13181:x1871643144202624:12345-0@lo:104: 00010000:00010000:0.0:1784938256.492966:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493021:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938256.493028:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+4:13181:x1871643144202624:12345-0@lo:104: Request processed in 80us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938256.493036:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784938256.493055:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784938256.493061:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13181:x1871643144202752:12345-0@lo:104: 00010000:00010000:0.0:1784938256.493076:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493109:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784938256.493114:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13181:x1871643144202752:12345-0@lo:104: Request processed in 53us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938256.493121:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1784938256.493141:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938256.493149:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493157:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910bc7469800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938256.493162:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493172:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938256.493180:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938256.493186:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784938256.493250:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493258:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938256.493279:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493286:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910bc7469800/0x26783cd1c59ee369 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee370 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493308:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938256.493312:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493318:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938256.493321:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493329:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938256.493335:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938256.493342:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784938256.493356:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493362:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938256.493377:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493384:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ee35b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee362 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493396:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938256.493397:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938256.493399:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938256.493426:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee34d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493441:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee34d expref: 23 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938256.493451:0:13181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144203136:0@lo:104: 00000100:00100000:0.0:1784938256.493478:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938256.493498:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144203136 00000100:00100000:0.0:1784938256.493502:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144203136 00000100:00100000:0.0:1784938256.493522:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784938256.493528:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13181:x1871643144203136:12345-0@lo:104: 00010000:00010000:0.0:1784938256.493537:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493568:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938256.493573:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13181:x1871643144203136:12345-0@lo:104: Request processed in 46us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938256.493579:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1784938256.493606:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee33f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493615:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee33f expref: 23 pid: 6505 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938256.493624:0:13181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144203264:0@lo:104: 00000100:00100000:0.0:1784938256.493647:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938256.493663:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144203264 00000100:00100000:0.0:1784938256.493666:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144203264 00000100:00100000:0.0:1784938256.493680:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784938256.493684:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13181:x1871643144203264:12345-0@lo:104: 00010000:00010000:0.0:1784938256.493697:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493723:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784938256.493728:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13181:x1871643144203264:12345-0@lo:104: Request processed in 43us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938256.493734:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1784938256.493745:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938256.493748:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493755:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938256.493759:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493765:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938256.493771:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938256.493776:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784938256.493789:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493795:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938256.493802:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493809:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b77a00/0x26783cd1c59ee34d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee354 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493823:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938256.493827:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493832:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1600 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938256.493835:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493842:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938256.493847:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938256.493852:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784938256.493861:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493866:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938256.493871:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493876:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1600/0x26783cd1c59ee33f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee346 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493890:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938256.493891:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938256.493893:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938256.493922:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28575 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.493936:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28575 expref: 12 pid: 6506 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938256.493946:0:13181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144203648:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938256.493980:0:13181:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d29f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938256.494007:0:13181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144202624:0@lo:104: 00000100:00100000:0.0:1784938256.494014:0:13181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144202752:0@lo:104: 00000100:00100000:0.0:1784938256.494020:0:13181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144203136:0@lo:104: 00000100:00100000:0.0:1784938256.494025:0:13181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144203264:0@lo:104: 00010000:00010000:1.0:1784938256.494587:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938256.494605:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144202880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938256.494648:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938256.494686:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938256.494692:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144203520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938256.494709:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938256.494736:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144202880 00000100:00100000:1.0:1784938256.494740:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144202880 00010000:00010000:1.0:1784938256.494772:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee369 expref: 24 pid: 6506 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938256.494797:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144203520 00000100:00100000:1.0:1784938256.494799:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144203520 00010000:00010000:1.0:1784938256.494808:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee33f expref: 25 pid: 6505 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938256.494824:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784938256.494830:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+25:3641:x1871643144202880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938256.494843:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938256.494848:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee369 expref: 25 pid: 6506 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.494859:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee369 expref: 25 pid: 6506 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.494875:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7469000/0x26783cd1c59ee370 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee369 expref: 25 pid: 6506 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.494891:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938256.494937:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144202880:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938256.494945:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784938256.494961:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938256.494968:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3641:x1871643144203520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938256.494975:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938256.494980:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee33f expref: 23 pid: 6505 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.494999:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee33f expref: 23 pid: 6505 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.495009:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76000/0x26783cd1c59ee346 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee33f expref: 23 pid: 6505 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.495018:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938256.495040:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3641:x1871643144203520:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938256.495046:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938256.495086:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144203520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938256.495094:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144202880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938256.495477:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144203008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938256.495514:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938256.495556:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938256.495563:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144203392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938256.495583:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938256.495914:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938256.496359:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144203008 00000100:00100000:1.0:1784938256.496367:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144203008 00010000:00010000:1.0:1784938256.496396:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee35b expref: 22 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938256.496425:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144203392 00000100:00100000:1.0:1784938256.496428:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144203392 00010000:00010000:1.0:1784938256.496439:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee34d expref: 23 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938256.496466:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938256.496475:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3642:x1871643144203008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938256.496486:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938256.496492:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee35b expref: 23 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.496518:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee35b expref: 23 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.496534:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9246c00/0x26783cd1c59ee362 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee35b expref: 23 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.496548:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938256.496602:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3642:x1871643144203008:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938256.496610:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938256.496627:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784938256.496633:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3642:x1871643144203392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938256.496642:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938256.496647:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee34d expref: 21 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.496655:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee34d expref: 21 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.496665:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7469c00/0x26783cd1c59ee354 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee34d expref: 21 pid: 6507 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938256.496673:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938256.496692:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:3642:x1871643144203392:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938256.496698:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784938256.496728:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144203392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938256.496735:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144203008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938256.502896:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938256.504106:0:13181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144202496:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938256.504125:0:13181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1871643144203648:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938256.504195:0:13181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938256.506619:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938256.511914:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125239168 00000100:00100000:2.0:1784938256.511932:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125239168 00000100:00100000:0.0:1784938256.512592:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125239296 00000100:00100000:0.0:1784938256.512599:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125239296 00010000:00010000:0.0:1784938256.512664:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285b4 expref: 14 pid: 6505 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938256.512742:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28575 expref: 14 pid: 6506 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938256.513163:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:2.0:1784938256.513524:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+14:2395:x1871643125239296:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938256.513549:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938256.513559:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285b4 expref: 14 pid: 6505 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513576:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285b4 expref: 14 pid: 6505 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513606:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9247600/0x26783cd1c59ee385 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285b4 expref: 14 pid: 6505 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513629:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938256.513722:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125239296:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 548us (7117us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938256.513754:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:2.0:1784938256.513790:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:2.0:1784938256.513798:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:2395:x1871643125239168:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938256.513806:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938256.513811:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28575 expref: 12 pid: 6506 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513820:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28575 expref: 12 pid: 6506 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513830:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76600/0x26783cd1c59ee338 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28575 expref: 12 pid: 6506 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513843:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513852:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513871:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513879:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513887:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.513894:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.514024:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938256.514039:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.514049:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.514070:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938256.514082:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938256.514106:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:2395:x1871643125239168:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 308us (11229us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938256.514113:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00010000:00010000:3.0:1784938256.514422:0:13181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938256.514433:0:13181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938256.514449:0:13181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ee3a8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938256.996434:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938257.019211:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938257.019296:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938257.019325:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938257.019359:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938257.019393:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125239424 00000100:00100000:1.0:1784938257.019405:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125239424 00000100:00100000:1.0:1784938257.019463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125239680 00000100:00100000:1.0:1784938257.019466:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125239680 00000100:00100000:1.0:1784938257.019477:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125239552 00000100:00100000:1.0:1784938257.019478:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125239552 00000100:00100000:1.0:1784938257.019489:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125239808 00000100:00100000:1.0:1784938257.019491:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125239808 00000100:00100000:1.0:1784938257.019507:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 214 00000100:00100000:1.0:1784938257.019517:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125239424:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938257.019612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125239424:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 97us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938257.019620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 214 00000100:00100000:1.0:1784938257.019638:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 215 00000100:00100000:1.0:1784938257.019654:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125239680:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938257.019677:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125239680:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938257.019683:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 215 00000100:00100000:1.0:1784938257.019693:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 216 00000100:00100000:1.0:1784938257.019698:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125239552:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938257.019737:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125239552:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938257.019743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 216 00000100:00100000:1.0:1784938257.019752:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00100000:1.0:1784938257.019758:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125239808:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938257.019776:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125239808:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 18us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938257.019782:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00080000:3.0:1784938257.020169:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938257.020175:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938257.056806:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938257.056845:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144203776:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938257.057360:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938257.057376:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144203904:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938257.057666:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144204160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.057702:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144204672:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.057730:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144205184:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.057758:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784938257.057764:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144204288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.057791:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144204800:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.057837:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144205312:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938257.058577:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938257.058918:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938257.058962:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938257.058983:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938257.059004:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938257.059032:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938257.059058:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938257.059079:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938257.059112:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144203776 00000100:00100000:2.0:1784938257.059123:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144203776 00000100:00100000:3.0:1784938257.059387:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144204032:0@lo:400:kworker.0 00000100:00100000:3.0:1784938257.059450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938257.059491:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144204544:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938257.059541:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144205056:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938257.059567:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144205568:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938257.059599:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784938257.059606:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144204416:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938257.059633:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144204928:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938257.059677:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144205440:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938257.059715:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144204032 00000100:00100000:3.0:1784938257.059720:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144204032 00000100:00100000:3.0:1784938257.059773:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1784938257.059783:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:3643:x1871643144204032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938257.059852:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:3643:x1871643144204032:12345-0@lo:400:kworker.0 Request processed in 70us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938257.059879:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1784938257.059951:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144204032:0@lo:400:kworker.0 00000100:00100000:3.0:1784938257.060129:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938257.060799:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144203904 00000100:00100000:2.0:1784938257.060807:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144203904 00000100:00100000:2.0:1784938257.060837:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 96 00000100:00100000:2.0:1784938257.060846:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144203776:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938257.060894:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938257.060962:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144203776:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 116us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938257.060969:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 96 00000100:00100000:2.0:1784938257.060988:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 97 00000100:00100000:2.0:1784938257.060994:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144203904:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938257.061004:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938257.061023:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144203904:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 29us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938257.061030:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 97 00000100:00100000:2.0:1784938257.061057:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144204160 00000100:00100000:2.0:1784938257.061062:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144204160 00000100:00100000:2.0:1784938257.061084:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144204672 00000100:00100000:2.0:1784938257.061087:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144204672 00000100:00100000:2.0:1784938257.061100:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144205184 00000100:00100000:2.0:1784938257.061103:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144205184 00000100:00100000:2.0:1784938257.061115:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144204800 00000100:00100000:2.0:1784938257.061117:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144204800 00000100:00100000:2.0:1784938257.061131:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144205312 00000100:00100000:2.0:1784938257.061134:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144205312 00000100:00100000:0.0:1784938257.062054:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144204288 00000100:00100000:0.0:1784938257.062067:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144204288 00000100:00100000:0.0:1784938257.062116:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144204544 00000100:00100000:0.0:1784938257.062119:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144204544 00000100:00100000:0.0:1784938257.062140:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 137 00000100:00100000:0.0:1784938257.062159:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144204288:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.062285:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144204288:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 136us (3250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.062292:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 137 00000100:00100000:0.0:1784938257.062310:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 138 00000100:00100000:0.0:1784938257.062317:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144204544:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.062343:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144204544:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (2215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.062349:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 138 00000100:00100000:0.0:1784938257.062375:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 218 00000100:00100000:0.0:1784938257.062383:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144204160:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.062410:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144204160:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.062416:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 218 00000100:00100000:0.0:1784938257.062434:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 219 00000100:00100000:0.0:1784938257.062440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144204672:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.062463:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144204672:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (3480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.062484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 219 00000100:00100000:0.0:1784938257.062498:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 220 00000100:00100000:0.0:1784938257.062505:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144205184:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.062528:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144205184:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (3523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.062534:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 220 00000100:00100000:0.0:1784938257.062544:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 221 00000100:00100000:0.0:1784938257.062551:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144204800:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.062578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144204800:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.062584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 221 00000100:00100000:0.0:1784938257.062597:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 222 00000100:00100000:0.0:1784938257.062604:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144205312:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.062625:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144205312:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (3546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.062631:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 222 00000100:00100000:3.0:1784938257.063092:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938257.063294:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144205568 00000100:00100000:0.0:1784938257.063302:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144205568 00000100:00100000:0.0:1784938257.063347:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:0.0:1784938257.063355:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144205568:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.063395:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144205568:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 40us (3180us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.063402:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:0.0:1784938257.063460:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00080000:0.0:1784938257.063492:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938257.063499:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938257.063502:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938257.063519:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144205056 00000100:00100000:0.0:1784938257.063522:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144205056 00000100:00100000:0.0:1784938257.063555:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00100000:0.0:1784938257.063561:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144205056:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938257.063584:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144205056:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.063590:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00080000:0.0:1784938257.063603:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938257.070697:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938257.070788:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938257.070912:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144205440 00000100:00100000:1.0:1784938257.070927:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144205440 00000100:00100000:1.0:1784938257.071012:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 86 00000100:00100000:1.0:1784938257.071026:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144205440:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938257.071122:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144205440:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 98us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938257.071129:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 86 00000100:00100000:3.0:1784938257.071551:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144204416 00000100:00100000:3.0:1784938257.071559:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144204416 00000100:00100000:3.0:1784938257.071604:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 223 00000100:00100000:3.0:1784938257.071613:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144204416:12345-192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938257.077978:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb25500 x1871643144204800/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938257.078006:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144204800:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938257.078025:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb25f80 x1871643144205312/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938257.078035:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144205312:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938257.078163:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb26680 x1871643144205056/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938257.078175:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144205056:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938257.078191:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb27800 x1871643144205568/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938257.078200:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144205568:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938257.089405:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144204416:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 17771us (18704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938257.089427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 223 00000100:00100000:0.0:1784938257.089748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938257.090810:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144204288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938257.090834:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144204160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938257.090850:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144204672:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938257.090864:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144205184:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938257.090886:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd7dca80 x1871643144203776/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938257.090948:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144203776:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938257.091038:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144204416:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938257.091053:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144204544:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938257.091068:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77e9880 x1871643144203904/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938257.091082:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144203904:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938257.092662:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144204928 00000100:00100000:3.0:1784938257.092684:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144204928 00000100:00100000:3.0:1784938257.092799:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 87 00000100:00100000:3.0:1784938257.092812:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144204928:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938257.092935:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144204928:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 126us (3187us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938257.092943:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 87 00010000:00080000:1.0:1784938257.094395:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb24700 x1871643144205440/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938257.094421:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144205440:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938257.094754:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb26a00 x1871643144204928/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938257.094765:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144204928:192.168.203.126@tcp:400:kworker.0 00000100:00080000:0.0:1784938257.095279:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1784938257.829688:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938257.829697:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cece6d800 from 7 10000000:01000000:3.0:1784938257.829702:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938257.829747:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938257.829757:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938257.829780:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938257.829803:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144205696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938257.830085:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938257.830141:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938257.830552:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144205696 00000100:00100000:2.0:1784938257.830560:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144205696 00000100:00100000:2.0:1784938257.830648:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1784938257.830657:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144205696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938257.830685:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938257.830702:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee3af expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.830727:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee3af expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.830737:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee3af expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.830746:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7469800, rc 0) 00000100:00100000:2.0:1784938257.830804:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144205696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938257.830810:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1784938257.830908:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144205696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938257.830926:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938257.830938:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938257.831012:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144205824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938257.831052:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938257.845066:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144205824 00000100:00100000:3.0:1784938257.845080:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144205824 00000100:00100000:3.0:1784938257.845135:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784938257.845145:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144205824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938257.845325:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144205824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (14270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938257.845333:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1784938257.846371:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc98c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938257.846410:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144205824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938257.846466:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144205952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938257.846534:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938257.846555:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc98c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938257.846624:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144205952 00000100:00100000:3.0:1784938257.846630:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144205952 00000100:00100000:3.0:1784938257.846682:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1784938257.846691:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144205952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938257.846791:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144205952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938257.846798:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1784938257.847329:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144205952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784938257.848657:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784938257.849788:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784938257.849832:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938257.849845:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938257.849857:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938257.849884:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938257.849887:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cfd213000 from 7 10000000:01000000:3.0:1784938257.849889:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938257.850076:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938257.850085:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938257.850096:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938257.850120:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938257.850187:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938257.850266:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc74530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938257.850420:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144206080 00000100:00100000:2.0:1784938257.850428:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144206080 00000100:00100000:2.0:1784938257.850490:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784938257.850499:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144206080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938257.850511:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938257.850523:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee3bd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.850546:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee3bd expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.850558:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee3bd expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.850567:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7468200, rc 0) 00000100:00100000:2.0:1784938257.850607:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144206080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938257.850613:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1784938257.851771:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938257.851794:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938257.851806:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938257.851882:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938257.853008:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938257.853058:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc74530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938257.853984:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144206208 00000100:00100000:2.0:1784938257.853996:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144206208 00000100:00100000:2.0:1784938257.854060:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784938257.854070:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144206208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938257.854261:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144206208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938257.854269:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1784938257.854368:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938257.854415:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938257.854467:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938257.854516:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc74530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938257.854620:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144206336 00000100:00100000:2.0:1784938257.854625:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144206336 00000100:00100000:2.0:1784938257.854659:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784938257.854666:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144206336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938257.854741:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144206336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938257.854752:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1784938257.854833:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784938257.855769:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784938257.856733:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784938257.856763:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938257.856774:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.856786:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938257.856798:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938257.856801:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cc481d800 from 7 10000000:01000000:2.0:1784938257.856804:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938257.856839:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.856848:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.856858:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938257.856883:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938257.857010:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938257.857057:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4d840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938257.857114:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144206464 00000100:00100000:3.0:1784938257.857121:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144206464 00000100:00100000:3.0:1784938257.857168:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1784938257.857178:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144206464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938257.857191:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938257.857204:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee3cb expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938257.857251:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee3cb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938257.857263:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee3cb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938257.857271:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cd9246200, rc 0) 00000100:00100000:3.0:1784938257.857316:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144206464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938257.857322:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1784938257.857415:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938257.857430:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938257.857438:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938257.857503:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938257.857543:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938257.857566:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144206592 00000100:00100000:0.0:1784938257.857569:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144206592 00000100:00100000:0.0:1784938257.857591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1784938257.857597:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144206592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938257.857694:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144206592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.857708:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1784938257.857735:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d29000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938257.857747:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938257.857772:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938257.857805:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938257.857821:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144206720 00000100:00100000:0.0:1784938257.857825:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144206720 00000100:00100000:0.0:1784938257.857840:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1784938257.857846:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144206720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938257.858126:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144206720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938257.858133:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1784938257.858167:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d29000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938257.858179:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784938257.859398:0:13212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784938257.861355:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784938257.861403:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938257.861414:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938257.861426:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938257.861437:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784938257.861440:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cca3c9000 from 7 10000000:01000000:0.0:1784938257.861443:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938257.861487:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938257.861502:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938257.861521:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938257.861545:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938257.861608:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938257.861644:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d29000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938257.862040:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144206848 00000100:00100000:2.0:1784938257.862048:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144206848 00000100:00100000:2.0:1784938257.862098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1784938257.862107:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144206848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938257.862123:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938257.862141:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee3d9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.862165:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee3d9 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.862175:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee3d9 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938257.862184:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7469a00, rc 0) 00000100:00100000:2.0:1784938257.862261:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144206848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938257.862268:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1784938257.862489:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938257.862515:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938257.862525:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938257.862586:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938257.862616:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938257.862636:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d29000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938257.862793:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144206976 00000100:00100000:2.0:1784938257.862798:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144206976 00000100:00100000:2.0:1784938257.862832:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1784938257.862839:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144206976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938257.863068:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144206976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938257.863075:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784938257.870395:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144206976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938257.870603:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144207104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938257.870671:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938257.870778:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938257.871040:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144207104 00000100:00100000:2.0:1784938257.871047:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144207104 00000100:00100000:2.0:1784938257.871103:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1784938257.871111:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144207104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938257.871613:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144207104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 501us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938257.871622:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1784938257.871805:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144207104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784938257.872797:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784938257.873033:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784938257.873055:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938257.873066:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938257.873078:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938258.017241:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938258.079461:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938258.079488:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144207232:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938258.080035:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938258.080066:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144207232 00000100:00100000:1.0:1784938258.080073:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144207232 00000100:00100000:1.0:1784938258.080119:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 98 00000100:00100000:1.0:1784938258.080127:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144207232:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938258.080157:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938258.080202:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144207232:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938258.080210:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 98 00010000:00080000:1.0:1784938258.080356:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfb2d5180 x1871643144207232/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938258.080377:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144207232:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938258.081101:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938258.081132:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144207360:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938258.081413:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938258.081578:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144207360 00000100:00100000:1.0:1784938258.081585:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144207360 00000100:00100000:1.0:1784938258.081630:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 99 00000100:00100000:1.0:1784938258.081639:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144207360:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938258.081667:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938258.081709:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144207360:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 71us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938258.081716:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 99 00010000:00080000:1.0:1784938258.081984:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb25f80 x1871643144207360/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938258.082000:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144207360:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938258.367027:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938258.370340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125239936 00000100:00100000:0.0:1784938258.370355:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125239936 00000100:00100000:1.0:1784938258.380428:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 335 00000100:00100000:1.0:1784938258.380442:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:6166:x1871643125239936:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938258.380459:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938258.380478:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a285e5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938258.380520:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285e5 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938258.380532:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285e5 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938258.380541:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0800, rc 0) 00000100:00100000:1.0:1784938258.380609:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125239936:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 169us (13591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938258.380616:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 335 00000100:00100000:1.0:1784938258.388392:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938258.388483:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125240064 00000100:00100000:3.0:1784938258.388508:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125240064 00000100:00100000:3.0:1784938258.388564:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 336 00000100:00100000:3.0:1784938258.388573:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125240064:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938258.388723:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125240064:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938258.388731:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 336 00000100:00100000:1.0:1784938258.392864:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938258.393028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125240192 00000100:00100000:3.0:1784938258.393038:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125240192 00000100:00100000:3.0:1784938258.393095:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 337 00000100:00100000:3.0:1784938258.393104:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125240192:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938258.393272:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125240192:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 168us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938258.393281:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 337 00000100:00100000:0.0:1784938258.410825:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938258.410983:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125240320 00000100:00100000:1.0:1784938258.410993:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125240320 00000100:00100000:1.0:1784938258.411050:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 338 00000100:00100000:1.0:1784938258.411060:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125240320:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938258.411077:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938258.411095:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a285ec expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938258.411122:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ec expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938258.411132:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ec expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938258.411140:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1600, rc 0) 00000100:00100000:1.0:1784938258.411197:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125240320:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 139us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938258.411205:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 338 00000100:00100000:1.0:1784938258.415515:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938258.418469:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125240448 00000100:00100000:3.0:1784938258.418493:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125240448 00000100:00100000:3.0:1784938258.418567:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 339 00000100:00100000:3.0:1784938258.418577:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125240448:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938258.418738:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125240448:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 161us (3230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938258.418746:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 339 00000100:00100000:0.0:1784938258.429338:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938258.429425:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125240576 00000100:00100000:3.0:1784938258.429435:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125240576 00000100:00100000:3.0:1784938258.429503:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 340 00000100:00100000:3.0:1784938258.429523:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125240576:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938258.429664:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125240576:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938258.429672:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 340 00010000:00010000:2.0:1784938259.039544:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938259.104796:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938259.104821:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144207488:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938259.105087:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938259.105168:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144207488 00000100:00100000:0.0:1784938259.105176:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144207488 00000100:00100000:0.0:1784938259.105246:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 139 00000100:00100000:0.0:1784938259.105256:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144207488:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938259.105287:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938259.105328:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144207488:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938259.105336:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 139 00000100:00100000:3.0:1784938259.105838:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144207488:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:0.0:1784938260.064397:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938260.571007:0:13380:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784938260.639418:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938260.639457:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfb2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144207616:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938260.639772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938260.640375:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144207616 00000100:00100000:1.0:1784938260.640384:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144207616 00000100:00100000:1.0:1784938260.640642:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 140 00000100:00100000:1.0:1784938260.640654:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144207616:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938260.640819:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938260.640903:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144207616:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 251us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938260.640923:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 140 00000100:00100000:2.0:1784938260.641149:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfb2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144207616:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:1.0:1784938261.087547:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938262.115466:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938262.136111:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938262.136157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938262.136196:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938262.136256:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938262.136280:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938262.136356:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125240960 00000100:00100000:0.0:1784938262.136366:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125240960 00000100:00100000:0.0:1784938262.136431:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125241216 00000100:00100000:0.0:1784938262.136435:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125241216 00000100:00100000:0.0:1784938262.136449:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125240832 00000100:00100000:0.0:1784938262.136452:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125240832 00000100:00100000:0.0:1784938262.136464:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125241088 00000100:00100000:0.0:1784938262.136467:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125241088 00000100:00100000:0.0:1784938262.136482:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 224 00000100:00100000:0.0:1784938262.136507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125240960:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938262.136583:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125240960:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 77us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938262.136591:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 224 00000100:00100000:0.0:1784938262.136608:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 225 00000100:00100000:0.0:1784938262.136614:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125241216:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938262.136651:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125241216:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 37us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938262.136658:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 225 00000100:00100000:0.0:1784938262.136671:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 226 00000100:00100000:0.0:1784938262.136676:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125240832:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938262.136699:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125240832:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938262.136705:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 226 00000100:00100000:0.0:1784938262.136718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:0.0:1784938262.136723:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125241088:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938262.136744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125241088:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 21us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938262.136750:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:1.0:1784938262.137300:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125240704 00000100:00100000:1.0:1784938262.137306:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125240704 00000100:00100000:1.0:1784938262.137348:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 341 00000100:00100000:1.0:1784938262.137356:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125240704:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.137401:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125240704:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 46us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.137416:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 341 00000100:00080000:2.0:1784938262.137545:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938262.137549:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938262.175456:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938262.175482:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144207744:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938262.175722:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.175802:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144207744 00000100:00100000:1.0:1784938262.175809:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144207744 00000100:00100000:1.0:1784938262.175876:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 100 00000100:00100000:1.0:1784938262.175887:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144207744:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938262.175917:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938262.175962:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144207744:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.175969:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 100 00010000:00080000:1.0:1784938262.176092:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77e9f80 x1871643144207744/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938262.176109:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144207744:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938262.176412:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144208128:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938262.176446:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144208640:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938262.176467:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144209152:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938262.176495:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784938262.176500:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144208000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938262.176518:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144208512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938262.176534:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144209024:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.176606:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144208256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.176632:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144208768:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.176649:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144209280:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.176676:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784938262.176682:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144207872:0@lo:400:kworker.0 00000100:00100000:1.0:1784938262.176710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938262.176740:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144208384:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.176757:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144208896:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.176911:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.176964:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.176982:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.176998:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.177013:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.177038:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.177057:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.177076:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.177090:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.177107:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.177159:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.177180:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144208768 00000100:00100000:1.0:1784938262.177185:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144208768 00000100:00100000:1.0:1784938262.177238:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144209280 00000100:00100000:1.0:1784938262.177241:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144209280 00000100:00100000:1.0:1784938262.177254:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144208896 00000100:00100000:1.0:1784938262.177256:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144208896 00000100:00100000:1.0:1784938262.177270:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 88 00000100:00100000:1.0:1784938262.177276:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144208768:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177312:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144208768:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177327:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 88 00000100:00100000:1.0:1784938262.177341:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 89 00000100:00100000:1.0:1784938262.177346:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144209280:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177367:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144209280:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177372:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 89 00000100:00100000:1.0:1784938262.177380:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 90 00000100:00100000:1.0:1784938262.177386:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144208896:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177401:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144208896:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177406:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 90 00000100:00100000:1.0:1784938262.177424:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144208128 00000100:00100000:1.0:1784938262.177427:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144208128 00000100:00100000:1.0:1784938262.177444:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144208384 00000100:00100000:1.0:1784938262.177446:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144208384 00000100:00100000:1.0:1784938262.177457:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 141 00000100:00100000:1.0:1784938262.177462:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144208128:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177485:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144208128:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177491:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 141 00000100:00100000:1.0:1784938262.177501:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 142 00000100:00100000:1.0:1784938262.177506:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144208384:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177525:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144208384:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 19us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177539:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 142 00000100:00100000:1.0:1784938262.177559:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144208640 00000100:00100000:1.0:1784938262.177563:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144208640 00000100:00100000:1.0:1784938262.177580:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144208000 00000100:00100000:1.0:1784938262.177582:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144208000 00000100:00100000:1.0:1784938262.177591:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144209152 00000100:00100000:1.0:1784938262.177593:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144209152 00000100:00100000:1.0:1784938262.177602:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144209024 00000100:00100000:1.0:1784938262.177604:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144209024 00000100:00100000:1.0:1784938262.177614:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144208512 00000100:00100000:1.0:1784938262.177616:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144208512 00000100:00100000:1.0:1784938262.177626:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144208256 00000100:00100000:1.0:1784938262.177628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144208256 00000100:00100000:1.0:1784938262.177639:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 228 00000100:00100000:1.0:1784938262.177644:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144208640:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177669:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144208640:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177675:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 228 00000100:00100000:1.0:1784938262.177685:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 229 00000100:00100000:1.0:1784938262.177691:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144208000:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177713:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144208000:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177719:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 229 00000100:00100000:1.0:1784938262.177730:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 230 00000100:00100000:1.0:1784938262.177737:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144209152:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177759:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144209152:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177771:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 230 00000100:00100000:1.0:1784938262.177781:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 231 00000100:00100000:1.0:1784938262.177786:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144209024:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177807:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144209024:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177811:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 231 00000100:00100000:1.0:1784938262.177821:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 232 00000100:00100000:1.0:1784938262.177827:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144208512:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144208512:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 17us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177848:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 232 00000100:00100000:1.0:1784938262.177858:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 233 00000100:00100000:1.0:1784938262.177874:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144208256:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.177894:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144208256:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 30us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.177900:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 233 00000100:00100000:1.0:1784938262.178181:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144208000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.178194:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144208512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.178205:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144209024:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.178236:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144208128:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938262.178248:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb24a80 x1871643144208640/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938262.178263:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144208640:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938262.178274:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7ddaa00 x1871643144209152/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938262.178280:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144209152:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.178316:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144208384:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938262.178324:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb26300 x1871643144208896/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938262.178331:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144208896:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938262.178340:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144208256:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938262.178348:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb27100 x1871643144208768/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938262.178356:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144208768:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938262.178363:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7dd8380 x1871643144209280/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938262.178370:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144209280:192.168.203.126@tcp:400:kworker.0 00000100:00080000:3.0:1784938262.178466:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938262.178470:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938262.178472:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938262.178475:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938262.178563:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144207872 00000100:00100000:0.0:1784938262.178568:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144207872 00000100:00100000:0.0:1784938262.178599:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1784938262.178605:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144207872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938262.178656:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144207872:12345-0@lo:400:kworker.0 Request processed in 51us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938262.178661:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1784938262.178720:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144207872:0@lo:400:kworker.0 00000100:00100000:0.0:1784938262.180603:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144209408:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938262.188555:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938262.188591:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144209408 00000100:00100000:1.0:1784938262.188598:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144209408 00000100:00100000:1.0:1784938262.188660:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 101 00000100:00100000:1.0:1784938262.188670:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144209408:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938262.188706:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938262.188766:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144209408:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 98us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938262.188774:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 101 00010000:00080000:1.0:1784938262.188911:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587ca80 x1871643144209408/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938262.188933:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144209408:192.168.203.126@tcp:13:osp-pre-1-0.0 00010000:00010000:0.0:1784938263.135764:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938263.199605:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144209536:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938263.199841:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938263.199849:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144209664:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938263.200321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938263.200383:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938263.200411:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144209536 00000100:00100000:0.0:1784938263.200421:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144209536 00000100:00100000:0.0:1784938263.200468:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144209664 00000100:00100000:0.0:1784938263.200471:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144209664 00000100:00100000:0.0:1784938263.200489:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 102 00000100:00100000:0.0:1784938263.200498:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144209536:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938263.200551:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938263.200772:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144209536:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 274us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938263.200780:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 102 00000100:00100000:0.0:1784938263.200800:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 103 00000100:00100000:0.0:1784938263.200807:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144209664:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938263.200819:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938263.200839:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144209664:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 33us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938263.200846:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 103 00010000:00080000:3.0:1784938263.201053:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7dd9500 x1871643144209664/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938263.201078:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144209664:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00080000:3.0:1784938263.201094:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587d880 x1871643144209536/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938263.201107:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144209536:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938264.161417:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938264.223738:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938264.223777:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144209792:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938264.224421:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938264.224460:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144209792 00000100:00100000:3.0:1784938264.224469:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144209792 00000100:00100000:3.0:1784938264.224530:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 143 00000100:00100000:3.0:1784938264.224539:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144209792:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938264.224583:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784938264.224639:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144209792:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938264.224647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 143 00000100:00100000:3.0:1784938264.224791:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144209792:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:2.0:1784938265.185704:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938265.759628:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938265.759665:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144209920:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938265.760178:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938265.760547:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144209920 00000100:00100000:1.0:1784938265.760559:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144209920 00000100:00100000:1.0:1784938265.760638:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 144 00000100:00100000:1.0:1784938265.760650:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144209920:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938265.760700:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938265.760776:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144209920:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 127us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938265.760784:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 144 00000100:00100000:1.0:1784938265.761327:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144209920:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938266.208160:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938266.697797:0:13530:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:11:04 (1784938264) === 00000100:00100000:3.0:1784938266.889072:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938266.889138:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938266.889326:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125241344 00000100:00100000:1.0:1784938266.889336:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125241344 00000100:00100000:1.0:1784938266.889404:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1784938266.889414:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125241344:12345-192.168.203.26@tcp:41:mkdir.0 00000004:00000024:1.0:1784938266.889449:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784938266.889536:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2394:x1871643125241344:12345-192.168.203.26@tcp:41:mkdir.0 Request processed in 124us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938266.889557:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00080000:3.0:1784938266.889795:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938266.889871:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125241472 00000100:00100000:2.0:1784938266.889876:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125241472 00000100:00100000:2.0:1784938266.889913:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:2.0:1784938266.889925:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:10498:x1871643125241472:12345-192.168.203.26@tcp:700:mkdir.0 00000100:00100000:2.0:1784938266.889969:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:10498:x1871643125241472:12345-192.168.203.26@tcp:700:mkdir.0 Request processed in 47us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938266.889976:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:3.0:1784938266.896392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938266.898422:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125241728 00000100:00100000:0.0:1784938266.898436:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125241728 00000100:00100000:0.0:1784938266.898523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:0.0:1784938266.898534:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:10498:x1871643125241728:12345-192.168.203.26@tcp:36:mkdir.0 00010000:00010000:0.0:1784938266.898589:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938266.898616:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee297 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28560 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.898637:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910ccee40b00) 00010000:00010000:0.0:1784938266.898698:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938266.898774:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.898804:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.898814:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.898851:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.898859:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.898866:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899389:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899398:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899405:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938266.899418:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b6f4d76 reply state 00000000cf7836d3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899428:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899435:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58be00) 00010000:00010000:0.0:1784938266.899443:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938266.899446:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784938266.899451:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784938266.899458:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899465:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899471:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899477:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938266.899481:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899487:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899496:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b100) 00010000:00010000:0.0:1784938266.899498:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938266.899502:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899508:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee3f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938266.899522:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b6f4d76 reply state 00000000cf7836d3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899529:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.899546:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910cfd58bc00) 00010000:00010000:0.0:1784938266.899548:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938266.899550:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784938266.899631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:10498:x1871643125241728:12345-192.168.203.26@tcp:36:mkdir.0 Request processed in 1098us (3256us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784938266.899638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1784938266.906980:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938266.910717:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125241856 00000100:00100000:1.0:1784938266.910733:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125241856 00000100:00100000:0.0:1784938266.910944:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:0.0:1784938266.910956:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:10499:x1871643125241856:12345-192.168.203.26@tcp:101:chmod.0 00010000:00010000:0.0:1784938266.910978:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938266.911002:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee40a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a285f3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.911068:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee411 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.911082:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.911092:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938266.911136:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784938266.911140:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938266.911173:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.911197:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee40a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285f3 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.911267:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285f3 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.911277:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b800) 00010000:00010000:0.0:1784938266.911281:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938266.911293:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76000, rc 0) 00000100:00100000:0.0:1784938266.911416:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:10499:x1871643125241856:12345-192.168.203.26@tcp:101:chmod.0 Request processed in 462us (4446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938266.911423:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:1.0:1784938266.920798:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938266.920933:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125242112 00000100:00100000:0.0:1784938266.920944:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125242112 00000100:00100000:0.0:1784938266.921011:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1784938266.921021:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:10499:x1871643125242112:12345-192.168.203.26@tcp:36:chmod.0 00010000:00010000:0.0:1784938266.921078:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938266.921105:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee411 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285f3 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.921126:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b800) 00010000:00010000:0.0:1784938266.921136:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938266.921160:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.921173:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.921182:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938266.921420:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000860cf0e4 reply state 000000009015cf91 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.921432:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.921439:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b100) 00010000:00010000:0.0:1784938266.921442:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784938266.921445:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784938266.921452:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784938266.921530:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:10499:x1871643125242112:12345-192.168.203.26@tcp:36:chmod.0 Request processed in 510us (740us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784938266.921537:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1784938266.950069:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938266.950258:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125242240 00000100:00100000:2.0:1784938266.950272:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125242240 00000100:00100000:2.0:1784938266.950610:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1784938266.950624:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:10500:x1871643125242240:12345-192.168.203.26@tcp:101:chown.0 00010000:00010000:2.0:1784938266.950659:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938266.950683:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee41f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a285fa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938266.950760:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469200/0x26783cd1c59ee426 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938266.950775:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469200/0x26783cd1c59ee426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938266.950787:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469200/0x26783cd1c59ee426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938266.951514:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784938266.951520:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938266.951569:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469200/0x26783cd1c59ee426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938266.951600:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee41f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285fa expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938266.951621:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469200/0x26783cd1c59ee426 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285fa expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938266.951630:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b100) 00010000:00010000:2.0:1784938266.951634:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938266.951638:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7469200, rc 0) 00000100:00100000:2.0:1784938266.951717:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:10500:x1871643125242240:12345-192.168.203.26@tcp:101:chown.0 Request processed in 1097us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938266.951725:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:1.0:1784938266.954399:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938266.954514:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125242368 00000100:00100000:0.0:1784938266.954527:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125242368 00000100:00100000:0.0:1784938266.954606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:0.0:1784938266.954618:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:10500:x1871643125242368:12345-192.168.203.26@tcp:101:chown.0 00010000:00010000:0.0:1784938266.954649:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938266.954679:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee42d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.954948:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.954969:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.954982:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955015:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955023:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955030:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955127:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee442 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955136:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee442 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955143:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee442 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938266.955196:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784938266.955201:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938266.955649:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee442 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955667:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955673:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955681:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955699:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938266.955704:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955713:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955791:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b100) 00010000:00010000:0.0:1784938266.955794:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938266.955800:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.955953:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956022:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956030:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956036:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956042:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938266.956045:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956052:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956073:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910cfd58bc00) 00010000:00010000:0.0:1784938266.956076:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938266.956079:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956085:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee43b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956126:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee42d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28601 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956142:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee442 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28601 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.956150:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58be00) 00010000:00010000:0.0:1784938266.956152:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938266.956155:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77800, rc 0) 00000100:00100000:0.0:1784938266.956665:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:10500:x1871643125242368:12345-192.168.203.26@tcp:101:chown.0 Request processed in 2044us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938266.956675:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:1.0:1784938266.959472:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938266.959573:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125242496 00000100:00100000:3.0:1784938266.959588:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125242496 00000100:00100000:3.0:1784938266.959698:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1784938266.959712:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:10500:x1871643125242496:12345-192.168.203.26@tcp:900:chown.0 00000100:00100000:3.0:1784938266.959949:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:10500:x1871643125242496:12345-192.168.203.26@tcp:900:chown.0 Request processed in 125us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938266.959969:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:2.0:1784938266.965427:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938266.965893:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125242752 00000100:00100000:3.0:1784938266.965906:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125242752 00000100:00100000:3.0:1784938266.966002:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:3.0:1784938266.966014:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:10500:x1871643125242752:12345-192.168.203.26@tcp:36:chown.0 00010000:00010000:3.0:1784938266.966090:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938266.966127:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee442 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28601 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938266.966153:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58be00) 00010000:00010000:3.0:1784938266.966160:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938266.966201:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938266.966365:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938266.966378:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938266.974994:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1784938266.975148:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975163:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938266.975164:0:9526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038b0a035 reply state 00000000adce01d4 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975171:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975193:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938266.975197:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975204:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975256:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910cfd58bc00) 00010000:00010000:0.0:1784938266.975260:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938266.975264:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975271:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee3fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975292:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975297:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975302:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975306:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938266.975309:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975315:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975334:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58be00) 00010000:00010000:0.0:1784938266.975346:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938266.975356:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975365:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee403 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938266.975371:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975380:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938266.975384:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58be00) 00010000:00010000:3.0:1784938266.975392:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784938266.975399:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938266.975401:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975408:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975413:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938266.975415:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975421:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975429:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b100) 00010000:00010000:0.0:1784938266.975432:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784938266.975435:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.975441:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee418 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938266.975748:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1784938266.975888:0:9526:0:(ldlm_lib.c:3477:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784938266.975916:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:10500:x1871643125242752:12345-192.168.203.26@tcp:36:chown.0 Request processed in 9898us (10498us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784938266.975926:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00010000:00010000:0.0:1784938266.976978:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.976994:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.977002:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.977008:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938266.977013:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.977021:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.977033:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58be00) 00010000:00010000:0.0:1784938266.977035:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784938266.977040:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938266.977045:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee449 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938266.989082:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938266.989199:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125242880 00000100:00100000:0.0:1784938266.989209:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125242880 00000100:00100000:0.0:1784938266.989308:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:0.0:1784938266.989317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:10501:x1871643125242880:12345-192.168.203.26@tcp:101:touch.500 00010000:00010000:0.0:1784938266.989340:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938266.989360:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28608 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938266.998597:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 9158us 00010000:00010000:0.0:1784938267.025612:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.025638:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.025651:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.025667:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.025674:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.025681:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.025809:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee465 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.025819:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.025827:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938267.026385:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784938267.026390:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938267.026935:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.026953:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.026960:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.026968:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.026974:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938267.026978:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.026985:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027000:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b100) 00010000:00010000:0.0:1784938267.027003:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938267.027008:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027014:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027030:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027036:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027042:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027054:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938267.027058:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027064:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027073:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910cfd58be00) 00010000:00010000:0.0:1784938267.027076:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938267.027079:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027084:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee45e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027127:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28608 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027142:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee465 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28608 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.027149:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58bc00) 00010000:00010000:0.0:1784938267.027151:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784938267.027153:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76000, rc 0) 00000100:00100000:0.0:1784938267.027256:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:10501:x1871643125242880:12345-192.168.203.26@tcp:101:touch.500 Request processed in 37939us (38182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938267.027265:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:1.0:1784938267.036826:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938267.037154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125243136 00000100:00100000:0.0:1784938267.037175:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125243136 00000100:00100000:0.0:1784938267.037258:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:0.0:1784938267.037268:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:10501:x1871643125243136:12345-192.168.203.26@tcp:101:touch.500 00010000:00010000:0.0:1784938267.037288:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938267.037311:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee46c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2860f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.037423:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.037436:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.037446:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.037742:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.037751:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.037759:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938267.038407:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1784938267.038916:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee481 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.038929:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.038950:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039051:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039059:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039066:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039072:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938267.039076:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039083:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039096:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58bc00) 00010000:00010000:0.0:1784938267.039099:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938267.039103:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039109:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee473 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938267.039123:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057eae982 reply state 0000000006af413d transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039134:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039147:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff910cfd58be00) 00010000:00010000:0.0:1784938267.039150:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938267.039153:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938267.039427:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee46c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2860f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039443:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee481 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2860f expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.039512:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff910cfd58b800) 00010000:00010000:0.0:1784938267.039516:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938267.039519:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77000, rc 0) 00000100:00100000:1.0:1784938267.039702:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:10501:x1871643125243136:12345-192.168.203.26@tcp:101:touch.500 Request processed in 2433us (2883us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1784938267.039711:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:1.0:1784938267.049027:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938267.049100:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125243392 00000100:00100000:3.0:1784938267.049110:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125243392 00000100:00100000:3.0:1784938267.049181:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:3.0:1784938267.049190:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:10501:x1871643125243392:12345-192.168.203.26@tcp:36:touch.500 00010000:00010000:3.0:1784938267.049284:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938267.049312:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee481 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2860f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938267.049338:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff910cfd58b800) 00010000:00010000:3.0:1784938267.049350:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938267.049406:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938267.049418:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938267.049428:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938267.049540:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af545f1c reply state 00000000d5f5f80e transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938267.049552:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938267.049559:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff910cced89000) 00010000:00010000:3.0:1784938267.049561:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938267.049564:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938267.049646:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:10501:x1871643125243392:12345-192.168.203.26@tcp:36:touch.500 Request processed in 456us (626us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784938267.049668:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:3.0:1784938267.051040:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938267.051122:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125243520 00000100:00100000:0.0:1784938267.051130:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125243520 00000100:00100000:0.0:1784938267.051188:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:0.0:1784938267.051197:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:10501:x1871643125243520:12345-192.168.203.26@tcp:101:touch.500 00010000:00010000:0.0:1784938267.051250:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938267.051269:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee496 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28616 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.051319:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee496 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28616 expref: 12 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.051333:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee496 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28616 expref: 12 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.051351:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff910cced89000) 00010000:00010000:0.0:1784938267.051364:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938267.051368:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76400, rc 0) 00000100:00100000:0.0:1784938267.051410:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:10501:x1871643125243520:12345-192.168.203.26@tcp:101:touch.500 Request processed in 214us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938267.051416:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:1.0:1784938267.054680:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938267.054804:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125243648 00000100:00100000:2.0:1784938267.054843:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125243648 00000100:00100000:2.0:1784938267.054905:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1784938267.054913:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2391:x1871643125243648:12345-192.168.203.26@tcp:8:touch.500 00010000:00080000:2.0:1784938267.054949:0:8430:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:2.0:1784938267.054979:0:8430:0:(genops.c:1406:class_connect()) connect: client 263deb07-6496-49f7-9596-7a44f1bd8c2b, cookie 0x26783cd1c59ee49d 00002000:00100000:2.0:1784938267.054992:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 263deb07-6496-49f7-9596-7a44f1bd8c2b/ffff910cffbcb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784938267.055010:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784938267.055085:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784938267.055119:0:8430:0:(import.c:65:import_set_state_nolock()) ffff910cffbc8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938267.055192:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2391:x1871643125243648:12345-192.168.203.26@tcp:8:touch.500 Request processed in 278us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938267.055199:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1784938267.057440:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938267.057528:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125243776 00000100:00100000:3.0:1784938267.057540:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125243776 00000100:00100000:3.0:1784938267.057638:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:3.0:1784938267.057649:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:0:x1871643125243776:12345-192.168.203.26@tcp:2:touch.500 00000100:00080000:2.0:1784938267.058347:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1784938267.077982:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1784938267.078004:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000100:00100000:3.0:1784938267.078315:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:0:x1871643125243776:12345-192.168.203.26@tcp:2:touch.500 Request processed in 20658us (20878us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784938267.078330:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:3.0:1784938267.083963:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938267.084072:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125244032 00000100:00100000:1.0:1784938267.084081:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125244032 00000100:00100000:1.0:1784938267.084143:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1784938267.084153:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:10501:x1871643125244032:12345-192.168.203.26@tcp:35:touch.500 00000100:00100000:1.0:1784938267.084507:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:10501:x1871643125244032:12345-192.168.203.26@tcp:35:touch.500 Request processed in 354us (555us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784938267.084515:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1784938267.107143:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938267.107274:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125244160 00000100:00100000:3.0:1784938267.107291:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125244160 00000100:00100000:2.0:1784938267.107531:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:2.0:1784938267.107544:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:10502:x1871643125244160:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:2.0:1784938267.107591:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938267.107621:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469000/0x26783cd1c59ee4a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2861d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.107714:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469c00/0x26783cd1c59ee4ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.107731:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469c00/0x26783cd1c59ee4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.107744:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469c00/0x26783cd1c59ee4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938267.107826:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784938267.107830:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938267.107888:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469c00/0x26783cd1c59ee4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.107919:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469000/0x26783cd1c59ee4a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2861d expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.107940:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469c00/0x26783cd1c59ee4ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2861d expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.107949:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58bc00) 00010000:00010000:2.0:1784938267.107953:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938267.108336:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910bc7469c00, rc 0) 00000100:00100000:2.0:1784938267.108428:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:10502:x1871643125244160:12345-192.168.203.26@tcp:101:rm.0 Request processed in 886us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938267.108438:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:3.0:1784938267.111867:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938267.113043:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125244416 00000100:00100000:0.0:1784938267.113059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125244416 00000100:00100000:0.0:1784938267.113151:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:0.0:1784938267.113164:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:10502:x1871643125244416:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:0.0:1784938267.113192:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938267.113238:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee4b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28624 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938267.113365:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784938267.113496:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee4b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28624 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.113509:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b100) 00010000:00010000:0.0:1784938267.113512:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938267.113516:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee4b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28624 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.113529:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77a00, rc 0) 00000100:00100000:0.0:1784938267.113611:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:10502:x1871643125244416:12345-192.168.203.26@tcp:101:rm.0 Request processed in 449us (1776us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1784938267.113642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1784938267.116658:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938267.116742:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125244544 00000100:00100000:3.0:1784938267.116759:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125244544 00000100:00100000:3.0:1784938267.116886:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:3.0:1784938267.116899:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:10502:x1871643125244544:12345-192.168.203.26@tcp:37:rm.0 00000100:00100000:3.0:1784938267.121322:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:10502:x1871643125244544:12345-192.168.203.26@tcp:37:rm.0 Request processed in 4408us (4655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938267.121340:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:0.0:1784938267.126678:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938267.126805:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125244800 00000100:00100000:2.0:1784938267.126819:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125244800 00000100:00100000:2.0:1784938267.127083:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:2.0:1784938267.127098:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:10502:x1871643125244800:12345-192.168.203.26@tcp:35:rm.0 00000100:00100000:2.0:1784938267.127680:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:10502:x1871643125244800:12345-192.168.203.26@tcp:35:rm.0 Request processed in 583us (1014us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784938267.127689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1784938267.130048:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938267.130121:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125245056 00000100:00100000:0.0:1784938267.130132:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125245056 00000100:00100000:0.0:1784938267.130193:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1784938267.130201:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:10502:x1871643125245056:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:0.0:1784938267.130321:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938267.130347:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee4c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2862b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.130487:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee4c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.130502:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee4c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.130513:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee4c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938267.130523:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784938267.130693:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee4c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2862b expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.130719:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee4c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2862b expref: 18 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938267.130729:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58bc00) 00010000:00010000:0.0:1784938267.130732:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784938267.130745:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77e00, rc 0) 00000100:00100000:0.0:1784938267.130855:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:10502:x1871643125245056:12345-192.168.203.26@tcp:101:rm.0 Request processed in 653us (817us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1784938267.130863:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:1.0:1784938267.134107:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938267.134251:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125245184 00000100:00100000:2.0:1784938267.134264:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125245184 00000100:00100000:2.0:1784938267.134359:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:2.0:1784938267.134371:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:10502:x1871643125245184:12345-192.168.203.26@tcp:41:rm.0 00000004:00000024:2.0:1784938267.134453:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1784938267.134594:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:10502:x1871643125245184:12345-192.168.203.26@tcp:41:rm.0 Request processed in 225us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938267.134603:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:0.0:1784938267.137453:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938267.137516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125245312 00000100:00100000:2.0:1784938267.137527:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125245312 00000100:00100000:2.0:1784938267.137645:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:2.0:1784938267.137657:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:10502:x1871643125245312:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:2.0:1784938267.137685:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938267.137714:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469000/0x26783cd1c59ee4d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28632 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.137802:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.137816:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.137827:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.137899:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.137906:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.137911:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138098:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1400/0x26783cd1c59ee4ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138106:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1400/0x26783cd1c59ee4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138111:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1400/0x26783cd1c59ee4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938267.138154:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784938267.138158:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938267.138178:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1400/0x26783cd1c59ee4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138193:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1400/0x26783cd1c59ee4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138202:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138210:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138248:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138256:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910bc7469e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938267.138261:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138270:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138290:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58bc00) 00010000:00010000:2.0:1784938267.138294:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938267.138299:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138306:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469e00/0x26783cd1c59ee4dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138320:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138327:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138334:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138339:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910bc7468c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938267.138342:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138348:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138354:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff910cfd58be00) 00010000:00010000:2.0:1784938267.138357:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938267.138360:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138366:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7468c00/0x26783cd1c59ee4e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138401:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469000/0x26783cd1c59ee4d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28632 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138411:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1400/0x26783cd1c59ee4ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28632 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.138417:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff910cced89000) 00010000:00010000:2.0:1784938267.138418:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938267.138420:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1400, rc 0) 00000100:00100000:2.0:1784938267.138531:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:10502:x1871643125245312:12345-192.168.203.26@tcp:101:rm.0 Request processed in 877us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938267.138537:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:1.0:1784938267.140930:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938267.141036:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125245568 00000100:00100000:2.0:1784938267.141048:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125245568 00000100:00100000:2.0:1784938267.141111:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:2.0:1784938267.141123:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:10502:x1871643125245568:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:2.0:1784938267.141199:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784938267.141319:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1400/0x26783cd1c59ee4ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28632 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141346:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ee496 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28616 expref: 18 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141360:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff910cced89000) 00010000:00010000:2.0:1784938267.141370:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469c00/0x26783cd1c59ee4ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2861d expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141391:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58bc00) 00010000:00010000:2.0:1784938267.141395:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938267.141423:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141437:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141448:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141461:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141468:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141475:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141724:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141731:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.141736:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938267.142016:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1784938267.142027:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335173812130ns, next at 336173809450ns, rc = 0 00010000:00010000:2.0:1784938267.142099:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142120:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142128:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142136:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142142:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142149:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142172:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938267.142200:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142206:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.142305:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938267.142314:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.142323:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0400 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938267.142329:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.142338:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.142352:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff910cced89000) 00010000:00010000:1.0:1784938267.142356:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938267.142361:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.142367:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee506 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.142381:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938267.142382:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.142384:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938267.142387:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938267.142394:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938267.142399:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142405:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142421:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff910cced89000) 00010000:00010000:2.0:1784938267.142424:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938267.142427:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142432:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0600/0x26783cd1c59ee4ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142450:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142456:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142462:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142468:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938267.142471:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142476:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142483:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58bc00) 00010000:00010000:2.0:1784938267.142486:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938267.142489:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142495:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee4f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938267.142519:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000308e97cb reply state 0000000050c4a111 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142532:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938267.142539:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff910cfd58be00) 00010000:00010000:2.0:1784938267.142541:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938267.142545:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938267.142663:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:10502:x1871643125245568:12345-192.168.203.26@tcp:36:rm.0 Request processed in 1539us (1744us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784938267.142673:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:1.0:1784938267.147125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938267.147645:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125245824 00000100:00100000:3.0:1784938267.147659:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125245824 00000100:00100000:3.0:1784938267.147735:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:3.0:1784938267.147751:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:10502:x1871643125245824:12345-192.168.203.26@tcp:35:rm.0 00000100:00100000:3.0:1784938267.148072:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:10502:x1871643125245824:12345-192.168.203.26@tcp:35:rm.0 Request processed in 322us (960us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784938267.148091:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1784938267.154381:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938267.154594:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125246080 00000100:00100000:1.0:1784938267.154609:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125246080 00000100:00100000:1.0:1784938267.154698:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:1.0:1784938267.154711:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:10502:x1871643125246080:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:1.0:1784938267.154797:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784938267.154830:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee4c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2862b expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.154892:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee465 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28608 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.154904:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910cfd58bc00) 00010000:00010000:1.0:1784938267.154932:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910bc7469200/0x26783cd1c59ee426 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285fa expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.154942:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cfd58b100) 00010000:00010000:1.0:1784938267.154949:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938267.154980:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.154996:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155007:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155021:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155028:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155034:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155141:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155158:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155165:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938267.155535:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784938267.155556:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155564:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155571:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155578:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938267.155582:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155591:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155600:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff910bc65fcc00) 00010000:00010000:1.0:1784938267.155603:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938267.155607:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155613:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0400/0x26783cd1c59ee51b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155634:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155647:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155652:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155657:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938267.155660:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155665:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155672:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cf3b7b400) 00010000:00010000:1.0:1784938267.155675:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938267.155678:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155683:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ee50d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938267.155696:0:9526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039d1a5d1 reply state 00000000ec77fde4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155708:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938267.155715:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910bc65fc100) 00010000:00010000:1.0:1784938267.155717:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938267.155720:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938267.155822:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:10502:x1871643125246080:12345-192.168.203.26@tcp:36:rm.0 Request processed in 1113us (1458us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784938267.157742:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00010000:00010000:2.0:1784938267.232397:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938267.256873:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938267.256974:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938267.257005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938267.257051:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938267.257054:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125246464 00000100:00100000:0.0:1784938267.257068:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125246464 00000100:00080000:1.0:1784938267.257118:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938267.257171:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125246336 00000100:00100000:0.0:1784938267.257174:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125246336 00000100:00100000:0.0:1784938267.257195:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125246592 00000100:00100000:0.0:1784938267.257198:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125246592 00000100:00100000:0.0:1784938267.257413:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 234 00000100:00100000:0.0:1784938267.257426:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125246464:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938267.257580:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125246464:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 158us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938267.257596:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 234 00000100:00100000:0.0:1784938267.257618:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 235 00000100:00100000:0.0:1784938267.257625:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125246336:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938267.257661:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125246336:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938267.257667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 235 00000100:00100000:0.0:1784938267.257681:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 236 00000100:00100000:0.0:1784938267.257688:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125246592:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938267.257714:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125246592:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938267.257745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 236 00000100:00080000:1.0:1784938267.259028:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938267.260691:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125246208 00000100:00100000:3.0:1784938267.260713:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125246208 00000100:00100000:3.0:1784938267.260805:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 343 00000100:00100000:3.0:1784938267.260815:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125246208:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938267.261332:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125246208:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 514us (4469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938267.261343:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 343 00000100:00100000:1.0:1784938267.295706:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144210048:0@lo:400:kworker.0 00000100:00100000:0.0:1784938267.295850:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144210176:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.295851:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938267.295945:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144210048 00000100:00100000:2.0:1784938267.295956:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144210048 00000100:00100000:0.0:1784938267.295978:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144210688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938267.296042:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1784938267.296055:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144210048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938267.296110:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144210432:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.300421:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144210560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.300678:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144211072:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.300708:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144211584:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.300762:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144210304:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.300796:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144210944:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.300824:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144211328:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.300860:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144211840:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938267.301169:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938267.304603:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144210048:12345-0@lo:400:kworker.0 Request processed in 8532us (8736us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938267.304623:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1784938267.304668:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144211200:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938267.304732:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144211712:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938267.304940:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938267.305308:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144211072 00000100:00100000:2.0:1784938267.305322:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144211072 00000100:00100000:0.0:1784938267.305390:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938267.305708:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938267.305941:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938267.306342:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938267.306699:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144211712 00000100:00100000:0.0:1784938267.306708:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144211712 00000100:00100000:2.0:1784938267.306773:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 91 00000100:00100000:2.0:1784938267.306794:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144211072:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938267.306909:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144211072:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 123us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938267.306917:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 91 00000100:00100000:2.0:1784938267.306961:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 92 00000100:00100000:2.0:1784938267.306968:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144211712:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938267.307000:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144211712:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938267.307006:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 92 00000100:00100000:1.0:1784938267.309945:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938267.310009:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144210304 00000100:00100000:1.0:1784938267.310022:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144210304 00000100:00100000:1.0:1784938267.310084:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144210560 00000100:00100000:1.0:1784938267.310088:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144210560 00000100:00100000:1.0:1784938267.310128:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 145 00000100:00100000:1.0:1784938267.310138:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144210304:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.310240:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144210304:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 103us (4851us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938267.310248:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 145 00000100:00100000:0.0:1784938267.310344:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144210176 00000100:00100000:0.0:1784938267.310361:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144210176 00000100:00100000:3.0:1784938267.310382:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 146 00000100:00100000:3.0:1784938267.310414:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144210560:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938267.310435:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144211328 00000100:00100000:0.0:1784938267.310443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144211328 00000100:00100000:3.0:1784938267.310455:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144210560:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 61us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938267.310465:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 146 00000100:00100000:0.0:1784938267.310471:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144210688 00000100:00100000:0.0:1784938267.310477:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144210688 00000100:00100000:0.0:1784938267.310504:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 237 00000100:00100000:0.0:1784938267.310513:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144210176:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938267.310636:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144210816:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938267.310685:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144211456:192.168.203.126@tcp:400:kworker.0 00000100:00080000:3.0:1784938267.310765:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938267.310772:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938267.310776:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938267.310903:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144210048:0@lo:400:kworker.0 00000100:00100000:3.0:1784938267.310950:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 238 00000100:00100000:3.0:1784938267.310961:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144211328:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938267.311008:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144211328:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 51us (5301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938267.311016:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 238 00000100:00100000:3.0:1784938267.311035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 239 00000100:00100000:3.0:1784938267.311042:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144210688:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938267.311063:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144210688:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (5123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938267.311069:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 239 00000100:00100000:3.0:1784938267.311160:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938267.311360:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938267.311437:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938267.311461:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938267.311486:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938267.311517:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144210944 00000100:00100000:3.0:1784938267.311522:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144210944 00000100:00100000:3.0:1784938267.311555:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144211456 00000100:00100000:3.0:1784938267.311558:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144211456 00000100:00100000:3.0:1784938267.311573:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 240 00000100:00100000:3.0:1784938267.311578:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144210944:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938267.311600:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144210944:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938267.311606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 240 00000100:00100000:3.0:1784938267.311619:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 241 00000100:00100000:3.0:1784938267.311625:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144211456:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938267.311642:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144211456:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938267.311656:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 241 00000100:00080000:3.0:1784938267.311672:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938267.311941:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144210176:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 1419us (10764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938267.311950:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144211584 00000100:00100000:1.0:1784938267.311956:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144211584 00000100:00100000:1.0:1784938267.312005:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144211200 00000100:00100000:1.0:1784938267.312008:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144211200 00000100:00100000:1.0:1784938267.312032:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 93 00000100:00100000:1.0:1784938267.312040:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144211584:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.312071:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144211584:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938267.312078:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 93 00000100:00100000:1.0:1784938267.312090:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 94 00000100:00100000:1.0:1784938267.312096:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144211200:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.312115:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144211200:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938267.312122:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 94 00000100:00080000:3.0:1784938267.312357:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938267.312361:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938267.313069:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 237 00000100:00100000:1.0:1784938267.313177:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938267.313203:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938267.313269:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144210176:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938267.313374:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144210688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938267.313399:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144210560:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938267.313401:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7dda680 x1871643144211200/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1784938267.313428:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7ddad80 x1871643144211072/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938267.313441:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144211072:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938267.313476:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7ddaa00 x1871643144211584/t0(0) o400->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938267.313487:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144211584:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938267.313574:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144211200:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938267.313604:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7dd9880 x1871643144211712/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938267.313615:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144211712:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938267.313629:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144211840 00000100:00100000:2.0:1784938267.313639:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144211840 00000100:00100000:2.0:1784938267.313688:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144210816 00000100:00100000:2.0:1784938267.313691:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144210816 00000100:00100000:0.0:1784938267.313708:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 104 00000100:00100000:0.0:1784938267.313722:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144211840:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938267.313858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144210432 00000100:00100000:1.0:1784938267.313864:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144210432 00000100:00100000:1.0:1784938267.313903:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 242 00000100:00100000:1.0:1784938267.313913:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144210432:12345-192.168.203.126@tcp:400:kworker.0 00002000:00000024:0.0:1784938267.313968:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938267.313991:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144210432:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 78us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938267.314000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 242 00000100:00100000:0.0:1784938267.314034:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144211840:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 313us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938267.314188:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144210432:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938267.314206:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7dd8380 x1871643144211456/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938267.314238:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144211456:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938267.316465:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7ddb800 x1871643144210944/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938267.316491:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144210944:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938267.316621:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144211328:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938267.316639:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77e8e00 x1871643144211840/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938267.316664:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144211840:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938267.316713:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144210304:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938267.320555:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 104 00000100:00100000:0.0:1784938267.320608:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 105 00000100:00100000:0.0:1784938267.320626:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144210816:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938267.320666:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938267.320820:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144210816:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 200us (7613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938267.320912:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 105 00010000:00080000:3.0:1784938267.326868:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587f480 x1871643144210816/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938267.326894:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144210816:192.168.203.126@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938268.257417:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938268.319444:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938268.319479:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144211968:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938268.319569:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938268.319584:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144212096:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938268.320330:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938268.320433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938268.320465:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144211968 00000100:00100000:1.0:1784938268.320475:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144211968 00000100:00100000:1.0:1784938268.320523:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144212096 00000100:00100000:1.0:1784938268.320526:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144212096 00000100:00100000:1.0:1784938268.320544:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 106 00000100:00100000:1.0:1784938268.320555:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144211968:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938268.320597:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938268.320668:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144211968:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 114us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938268.320693:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 106 00000100:00100000:1.0:1784938268.320715:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 107 00000100:00100000:1.0:1784938268.320721:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144212096:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938268.320733:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938268.320760:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144212096:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 38us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938268.320766:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 107 00010000:00080000:3.0:1784938268.320892:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77e8e00 x1871643144211968/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938268.320919:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144211968:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00080000:1.0:1784938268.321315:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77e8380 x1871643144212096/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938268.321331:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144212096:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00010000:1.0:1784938269.279525:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938269.343694:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938269.343733:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144212224:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938269.346593:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938269.346891:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144212224 00000100:00100000:2.0:1784938269.346902:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144212224 00000100:00100000:2.0:1784938269.346973:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 147 00000100:00100000:2.0:1784938269.347136:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144212224:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938269.347178:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784938269.347269:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144212224:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 287us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938269.347287:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 147 00000100:00100000:3.0:1784938269.350414:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144212224:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:2.0:1784938270.303794:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938270.879784:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938270.880176:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144212352:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938270.881550:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938270.881730:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144212352 00000100:00100000:1.0:1784938270.881742:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144212352 00000100:00100000:1.0:1784938270.882235:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 148 00000100:00100000:1.0:1784938270.882249:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144212352:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938270.882298:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938270.882386:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144212352:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 140us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938270.882394:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 148 00000100:00100000:1.0:1784938270.884874:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144212352:192.168.203.126@tcp:41:osp-pre-1-0.0 00000001:02000400:1.0:1784938271.296037:0:13677:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1784938271.330336:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938272.352512:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784938272.359439:0:13726:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc78b7e530 20000000:00000080:2.0:1784938272.359531:0:13726:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910cffb1f400 uarg=0000000000000000 20000000:01000000:2.0:1784938272.359591:0:13726:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1784938272.359599:0:13726:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1784938272.359605:0:13726:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1784938272.360414:0:13727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1784938272.360707:0:13726:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1784938272.368990:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1784938272.369071:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1784938272.369112:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1784938272.369146:0:13726:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784938272.369172:0:13726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.369194:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee3af expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.369202:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee3bd expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.369208:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee3cb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.369239:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee3d9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.369250:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285e5 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.369257:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ec expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.369265:0:13726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.369317:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ec expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.369339:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ec expref: 12 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.369371:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212480:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938272.370277:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285e5 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.370293:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285e5 expref: 12 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.370305:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212608:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938272.370376:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee3d9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.370386:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee3d9 expref: 23 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.370397:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212736:0@lo:104: 00000100:00100000:2.0:1784938272.373529:0:13726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938272.373599:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784938272.373639:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144212736 00000100:00100000:1.0:1784938272.373649:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144212736 00010000:00010000:2.0:1784938272.373657:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee3cb expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.373678:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee3cb expref: 23 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.373697:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212864:0@lo:104: 00000100:00100000:1.0:1784938272.373729:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938272.373741:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7735850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13726:x1871643144212736:12345-0@lo:104: 00000100:00100000:2.0:1784938272.373766:0:13726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784938272.373767:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938272.373792:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:2.0:1784938272.373793:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee3bd expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938272.373815:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1784938272.373852:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938272.373860:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7735850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13726:x1871643144212736:12345-0@lo:104: Request processed in 122us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.373869:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938272.373925:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144212864 00000100:00100000:1.0:1784938272.373929:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144212864 00000100:00100000:1.0:1784938272.373944:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938272.373950:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13726:x1871643144212864:12345-0@lo:104: 00010000:00010000:1.0:1784938272.373958:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.374003:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784938272.374008:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13726:x1871643144212864:12345-0@lo:104: Request processed in 59us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.374014:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1784938272.374033:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938272.374041:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938272.374043:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938272.374053:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77600 already unused, calling callback (ffffffffc14f4c20) 00010000:00010000:0.0:1784938272.374054:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938272.374058:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938272.374071:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910bc7468000 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938272.374075:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.374099:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938272.374099:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938272.374120:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938272.374121:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938272.374138:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784938272.374138:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784938272.374176:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938272.374182:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938272.374207:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938272.374233:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910bc7468000/0x26783cd1c59ee3cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938272.374246:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938272.374248:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938272.374256:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938272.375115:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.375130:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938272.375151:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.375158:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ee3d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3e0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.375173:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938272.375175:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938272.375178:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938272.375198:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144213248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938272.375282:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938272.376462:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938272.376504:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938272.376530:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938272.376562:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:2.0:1784938272.376583:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee3bd expref: 23 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938272.376595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938272.376626:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212992:0@lo:104: 00000100:00100000:1.0:1784938272.376645:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938272.376688:0:13726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938272.376855:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125246720 00000100:00100000:1.0:1784938272.376869:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125246720 00010000:00010000:2.0:1784938272.376889:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ee3af expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.376901:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ee3af expref: 23 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.376912:0:13726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144213376:0@lo:104: 00000100:00100000:1.0:1784938272.376937:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 345 00000100:00100000:2.0:1784938272.376944:0:13726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938272.376951:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125246720:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938272.376959:0:13726:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7c5e480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938272.376993:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212736:0@lo:104: 00000100:00100000:2.0:1784938272.377007:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212864:0@lo:104: 00000100:00100000:1.0:1784938272.377032:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125246720:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 84us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.377041:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 345 00000100:00100000:1.0:1784938272.377083:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125246976 00000100:00100000:1.0:1784938272.377088:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125246976 00000100:00100000:1.0:1784938272.377133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125247232 00000100:00100000:1.0:1784938272.377137:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125247232 00000100:00080000:2.0:1784938272.377141:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938272.377149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938272.377155:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125246848 00000100:00100000:1.0:1784938272.377159:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125246848 00000100:00100000:1.0:1784938272.377180:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125247360 00000100:00100000:1.0:1784938272.377182:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125247360 00000100:00080000:2.0:1784938272.377198:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938272.377199:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00080000:2.0:1784938272.377204:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938272.377209:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125246976:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.377372:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125246976:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 164us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.377379:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00100000:1.0:1784938272.377393:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 244 00000100:00100000:1.0:1784938272.377399:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125247232:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.377425:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125247232:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.377432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 244 00000100:00100000:1.0:1784938272.377444:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:1.0:1784938272.377450:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:2393:x1871643125246848:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.377492:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:2393:x1871643125246848:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 41us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.377499:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:1.0:1784938272.377511:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:1.0:1784938272.377518:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125247360:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.377544:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125247360:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.377550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:1.0:1784938272.377578:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125247104 00000100:00100000:1.0:1784938272.377582:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125247104 00000100:00100000:1.0:1784938272.377637:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:1.0:1784938272.377644:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125247104:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.377673:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125247104:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.377679:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00080000:1.0:1784938272.377705:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938272.377722:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144212992 00000100:00100000:1.0:1784938272.377726:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144212992 00000100:00100000:1.0:1784938272.377744:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144213376 00000100:00100000:1.0:1784938272.377887:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144213376 00000100:00100000:1.0:1784938272.377909:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784938272.377915:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:13726:x1871643144212992:12345-0@lo:104: 00010000:00010000:1.0:1784938272.377934:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378003:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938272.378016:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+4:13726:x1871643144212992:12345-0@lo:104: Request processed in 101us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.378023:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784938272.378036:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784938272.378043:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13726:x1871643144213376:12345-0@lo:104: 00010000:00010000:1.0:1784938272.378051:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378094:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784938272.378100:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+3:13726:x1871643144213376:12345-0@lo:104: Request processed in 58us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.378106:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1784938272.378125:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938272.378132:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378140:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247e00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:1.0:1784938272.378146:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378156:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938272.378164:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938272.378171:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784938272.378211:0:7463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378478:0:7463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938272.378505:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378511:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cd9247e00/0x26783cd1c59ee3bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378530:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938272.378534:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378539:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9246c00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:1.0:1784938272.378543:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378550:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938272.378557:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938272.378563:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784938272.378581:0:7463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378587:0:7463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938272.378597:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378604:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cd9246c00/0x26783cd1c59ee3af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ee3b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.378698:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938272.378701:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938272.378702:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938272.378720:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144213504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938272.378858:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938272.378926:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144213248 00000100:00100000:1.0:1784938272.378932:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144213248 00010000:00010000:1.0:1784938272.378958:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee3d9 expref: 24 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938272.378982:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144213504 00000100:00100000:1.0:1784938272.378984:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144213504 00010000:00010000:1.0:1784938272.378995:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee3bd expref: 25 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938272.379014:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784938272.379022:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+25:3642:x1871643144213248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938272.379036:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938272.379041:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee3d9 expref: 25 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.379053:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee3d9 expref: 25 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938272.379070:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:1.0:1784938272.379072:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7469a00/0x26783cd1c59ee3e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee3d9 expref: 25 pid: 6506 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.379090:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938272.379126:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144213248:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (3844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.379136:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784938272.379141:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938272.379155:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125247488 00000100:00100000:1.0:1784938272.379159:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125247488 00010000:00010000:1.0:1784938272.379172:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ec expref: 13 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938272.379182:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125247616 00000100:00100000:1.0:1784938272.379184:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125247616 00010000:00010000:1.0:1784938272.379194:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285e5 expref: 14 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938272.379209:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784938272.379300:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3643:x1871643144213504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938272.379311:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938272.379316:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee3bd expref: 23 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.379326:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee3bd expref: 23 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.379333:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00010000:00010000:1.0:1784938272.379340:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938272.379346:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+14:2393:x1871643125247488:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938272.379359:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938272.379366:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ec expref: 14 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938272.379370:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3643:x1871643144213504:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.379384:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:2.0:1784938272.379388:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ec expref: 14 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938272.379400:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00010000:00010000:2.0:1784938272.379404:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938272.379408:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+14:2393:x1871643125247616:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938272.379417:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938272.379429:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285e5 expref: 14 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.379440:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285e5 expref: 14 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.379450:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938272.379464:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+14:2393:x1871643125247488:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 120us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.379473:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+14:2393:x1871643125247616:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 64us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938272.379478:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:1.0:1784938272.379487:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:2.0:1784938272.379513:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144213632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938272.379558:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144213248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938272.379577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938272.379597:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144213504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938272.379636:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938272.379645:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144213120:0@lo:103:ldlm_bl.0 00000001:00080000:3.0:1784938272.379667:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:2.0:1784938272.379671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938272.379709:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144213632 00000100:00100000:2.0:1784938272.379713:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144213632 00010000:00010000:2.0:1784938272.379732:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee3af expref: 23 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938272.379734:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144213120 00000100:00100000:1.0:1784938272.379741:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144213120 00000100:00100000:2.0:1784938272.379757:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784938272.379766:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144213632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938272.379768:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee3cb expref: 24 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.379781:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938272.379788:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee3af expref: 24 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938272.379791:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784938272.379809:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144213120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938272.379821:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938272.379823:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee3af expref: 24 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.379829:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ee3cb expref: 24 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.379844:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ee3cb expref: 24 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938272.380005:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1784938272.380125:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938272.380130:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee3d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee3cb expref: 24 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.380160:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.380165:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3640:x1871643144213632:12345-0@lo:103:ldlm_bl.0 Request processed in 399us (587us total) trans 0 rc 0/0 00010000:00010000:1.0:1784938272.380175:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.380179:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1784938272.380196:0:7921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.380203:0:7921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.380210:0:7921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.380259:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144213632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938272.380294:0:7921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.380303:0:7921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938272.380308:0:7921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.380317:0:7921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.380327:0:7921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.380337:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938272.380373:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3640:x1871643144213120:12345-0@lo:103:ldlm_bl.0 Request processed in 565us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.380390:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:0.0:1784938272.380393:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938272.380420:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144213120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938272.381333:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381345:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381350:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381354:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938272.381358:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381363:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381376:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff910cfd58be00) 00010000:00010000:1.0:1784938272.381378:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938272.381381:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381385:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee47a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381402:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381406:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381421:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381424:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938272.381426:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381429:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381434:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff910cced89000) 00010000:00010000:1.0:1784938272.381435:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938272.381437:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381440:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247800/0x26783cd1c59ee48f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381459:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381462:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381465:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381468:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938272.381469:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381479:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381485:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff910cfd58be00) 00010000:00010000:1.0:1784938272.381486:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938272.381487:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381490:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee4f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381502:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381507:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381512:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381516:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938272.381518:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381524:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381532:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910bc65fc100) 00010000:00010000:1.0:1784938272.381534:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938272.381537:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.381550:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0000/0x26783cd1c59ee514 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.384302:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ee3ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ec expref: 12 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.384354:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212480:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938272.384376:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0800/0x26783cd1c59ee3e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285e5 expref: 11 pid: 6506 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.384389:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212608:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938272.384406:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7468200/0x26783cd1c59ee3c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee3bd expref: 21 pid: 6507 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.384415:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144212992:0@lo:104: 00010000:00010000:2.0:1784938272.384434:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7469800/0x26783cd1c59ee3b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ee3af expref: 20 pid: 6505 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938272.384445:0:13726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1871643144213376:0@lo:104: 00010000:00010000:2.0:1784938272.384501:0:13726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.384514:0:13726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.384521:0:13726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938272.384528:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cffbc1a00/0x26783cd1c59ee522 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938272.386621:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144213760:192.168.203.126@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938272.390477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938272.394294:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144213760 00000100:00100000:1.0:1784938272.394311:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144213760 00000100:00100000:1.0:1784938272.394388:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:1.0:1784938272.394398:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144213760:12345-192.168.203.126@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938272.394432:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1784938272.394469:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a63ff1a, atime: 0x6a63ff1a, ctime: 0x6a63ff1a, blocks: 0x0 00010000:00010000:1.0:1784938272.394477:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.394494:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1784938272.395542:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938272.395556:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.395583:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.395596:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.395604:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938272.395644:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938272.396073:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144213760:12345-192.168.203.126@tcp:6:osp-syn-1-0.0 Request processed in 1672us (5606us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784938272.396085:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00080000:1.0:1784938272.396149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784938272.397132:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938272.397146:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938272.397161:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0c00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938272.397168:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938272.397181:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938272.397208:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938272.397566:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910cffb55500/2, rc 0, transno 4294967301 00000100:00100000:2.0:1784938272.397589:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144213760:192.168.203.126@tcp:6:osp-syn-1-0.0 00010000:00010000:3.0:1784938272.397712:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079147fa3/0x26783cd1c59ee529 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938272.397742:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938272.397744:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938272.397746:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938272.415500:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144214144:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.416208:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144214656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.416272:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144213888:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.416358:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144214400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.416399:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938272.416408:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144214016:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.416437:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144214528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.416747:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938272.417098:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938272.417129:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938272.417155:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938272.417198:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938272.417212:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784938272.417259:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144214272:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938272.417297:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144214784:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938272.417374:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938272.417384:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938272.417422:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144214272 00000100:00100000:1.0:1784938272.417432:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144214272 00000100:00100000:3.0:1784938272.417460:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938272.417483:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144214784 00000100:00100000:1.0:1784938272.417488:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144214784 00000100:00100000:3.0:1784938272.417492:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144214016 00000100:00100000:3.0:1784938272.417499:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144214016 00000100:00100000:1.0:1784938272.417530:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 108 00000100:00100000:1.0:1784938272.417542:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871643144214272:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938272.417545:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144214400 00000100:00100000:3.0:1784938272.417550:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144214400 00000100:00100000:3.0:1784938272.417574:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 149 00000100:00100000:3.0:1784938272.417584:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144214016:12345-192.168.203.126@tcp:400:kworker.0 00002000:00000024:1.0:1784938272.417594:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938272.417643:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144214016:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 59us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938272.417652:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 149 00000100:00100000:3.0:1784938272.417679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 150 00000100:00100000:3.0:1784938272.417686:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144214400:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.417747:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1871643144214272:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 206us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938272.417751:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144214400:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 63us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.417759:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 108 00000100:00100000:3.0:1784938272.417771:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 150 00000100:00100000:1.0:1784938272.417784:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 109 00000100:00100000:1.0:1784938272.417793:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144214784:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938272.417904:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938272.417987:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144214784:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 195us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.417994:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 109 00000100:00100000:3.0:1784938272.418129:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144213888 00000100:00100000:3.0:1784938272.418136:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144213888 00000100:00100000:1.0:1784938272.418160:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144214144 00000100:00100000:1.0:1784938272.418166:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144214144 00000100:00100000:3.0:1784938272.418172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144214528 00000100:00100000:2.0:1784938272.418172:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144214016:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.418178:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144214528 00000100:00100000:1.0:1784938272.418192:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144214656 00000100:00100000:1.0:1784938272.418197:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144214656 00000100:00100000:3.0:1784938272.418238:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 247 00000100:00100000:3.0:1784938272.418247:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144213888:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938272.418289:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144214400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.418291:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144213888:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 43us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938272.418366:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 247 00000100:00100000:1.0:1784938272.418375:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 248 00000100:00100000:1.0:1784938272.418386:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144214144:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.418391:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 249 00000100:00100000:3.0:1784938272.418403:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144214528:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.418420:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144214144:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.418428:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 248 00000100:00100000:3.0:1784938272.418441:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144214528:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 39us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.418446:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 250 00000100:00100000:3.0:1784938272.418456:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 249 00000100:00100000:1.0:1784938272.418460:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144214656:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.418489:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144214656:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938272.418496:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 250 00000100:00080000:1.0:1784938272.418527:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938272.418532:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938272.418536:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938272.418659:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144214528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.418673:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144213888:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.419115:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144214912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.419194:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938272.419204:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144215040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938272.419236:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144215296:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938272.419448:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938272.419456:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144215168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938272.419649:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938272.419683:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938272.419715:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144214912 00000100:00100000:0.0:1784938272.419723:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144214912 00000100:00100000:2.0:1784938272.419724:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938272.419753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938272.419822:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144215040 00000100:00100000:0.0:1784938272.419827:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144215040 00000100:00100000:3.0:1784938272.419841:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144215296 00000100:00100000:3.0:1784938272.419847:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144215296 00000100:00100000:0.0:1784938272.419861:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 96 00000100:00100000:0.0:1784938272.419874:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144214912:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.419888:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144215168 00000100:00100000:3.0:1784938272.419903:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144215168 00000100:00100000:3.0:1784938272.419939:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 251 00000100:00100000:0.0:1784938272.419939:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144214912:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 64us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938272.419949:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144215296:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938272.419954:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 96 00000100:00100000:0.0:1784938272.419977:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 97 00000100:00100000:0.0:1784938272.419986:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144215040:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938272.419993:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144215296:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 44us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938272.420002:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 251 00000100:00100000:3.0:1784938272.420020:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 252 00000100:00100000:3.0:1784938272.420029:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144215168:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938272.420041:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144215040:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 55us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938272.420049:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 97 00000100:00100000:3.0:1784938272.420065:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144215168:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938272.420073:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 252 00000100:00100000:0.0:1784938272.420284:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144215168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.420961:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144214272:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938272.420980:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144214784:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00080000:1.0:1784938272.420994:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731f80 x1871643144214656/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938272.421023:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144214656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938272.421038:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144214144:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938272.421108:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731c00 x1871643144215296/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938272.421120:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144215296:192.168.203.126@tcp:400:kworker.0 00000100:00080000:0.0:1784938272.421167:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938272.421173:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938272.421178:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938272.421206:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731180 x1871643144215040/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938272.421243:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144215040:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938272.421260:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd732680 x1871643144214912/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938272.421270:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144214912:192.168.203.126@tcp:400:kworker.0 00000020:00000080:1.0:1784938273.190630:0:13777:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca5452570 20000000:00000080:1.0:1784938273.190647:0:13777:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910bc7c47c00 uarg=0000000000000000 20000000:01000000:1.0:1784938273.190687:0:13777:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1784938273.190694:0:13777:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1784938273.190699:0:13777:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1784938273.191471:0:13778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1784938273.191630:0:13777:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1784938273.191710:0:13777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1784938273.191739:0:13777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1784938273.191756:0:13777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1784938273.191767:0:13777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784938273.191786:0:13777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.191874:0:13777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.191885:0:13777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.191892:0:13777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.191899:0:13777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.191906:0:13777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.191983:0:13777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0400 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938273.191988:0:13777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.191996:0:13777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.192010:0:13777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.192017:0:13777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.192023:0:13777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0400/0x26783cd1c59ee530 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938273.379826:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938273.439453:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938273.439480:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144215424:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938273.439590:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144215552:192.168.203.126@tcp:13:osp-pre-0-1.0 10000000:01000000:1.0:1784938273.439590:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938273.439594:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cece6d800 from 7 10000000:01000000:1.0:1784938273.439598:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938273.439628:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.439638:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.439650:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938273.439664:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144215680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.439713:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938273.439749:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4d180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938273.439752:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938273.440521:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938273.440548:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144215680 00000100:00100000:1.0:1784938273.440556:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144215680 00000100:00100000:1.0:1784938273.440601:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1784938273.440610:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+20:6510:x1871643144215680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938273.440624:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938273.440640:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ee53e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee537 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.440666:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ee53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee537 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.440676:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ee53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee537 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.440685:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0600, rc 0) 00000100:00100000:1.0:1784938273.440725:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144215680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.440731:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1784938273.440764:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144215424 00000100:00100000:1.0:1784938273.440768:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144215424 00000100:00100000:1.0:1784938273.440783:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144215552 00000100:00100000:1.0:1784938273.440785:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144215552 00000100:00100000:1.0:1784938273.440813:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 110 00000100:00100000:1.0:1784938273.440819:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144215424:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938273.440839:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938273.440873:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144215424:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 54us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.440892:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 110 00000100:00100000:1.0:1784938273.440903:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 111 00000100:00100000:1.0:1784938273.440909:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144215552:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938273.440932:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938273.440954:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144215552:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 45us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.440960:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 111 00000100:00100000:1.0:1784938273.441132:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc489ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144215680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938273.441148:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.441158:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1784938273.441199:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910d01908e00 x1871643144215552/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938273.441237:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144215552:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938273.441254:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144215808:0@lo:501:ll_cfg_requeue.0 00010000:00080000:0.0:1784938273.441259:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7ddb100 x1871643144215424/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938273.441271:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144215424:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938273.441280:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938273.441301:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938273.441388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144215808 00000100:00100000:2.0:1784938273.441394:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144215808 00000100:00100000:2.0:1784938273.441425:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784938273.441433:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144215808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938273.441545:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144215808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938273.441551:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1784938273.441842:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144215808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.441876:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144215936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.441999:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938273.442025:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938273.443714:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144215936 00000100:00100000:1.0:1784938273.443724:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144215936 00000100:00100000:1.0:1784938273.443783:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1784938273.443860:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144215936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.444072:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144215936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.444079:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784938273.446618:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144215936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938273.448108:0:13790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13790:1871643144216064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938273.448205:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938273.448628:0:13790:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc6063180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938273.448743:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144216064 00000100:00100000:1.0:1784938273.448760:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144216064 00000100:00100000:1.0:1784938273.448820:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784938273.448830:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:13790:x1871643144216064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938273.449628:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+21:13790:x1871643144216064:12345-0@lo:502:llog_process_th.0 Request processed in 797us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.449637:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1784938273.450025:0:13790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13790:1871643144216064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938273.450059:0:13790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938273.450069:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938273.450071:0:13790:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784938273.450077:0:13790:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cece6d800 00000020:00000080:0.0:1784938273.450081:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938273.450147:0:13790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938273.450151:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938273.450160:0:13790:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784938273.450164:0:13790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938273.450167:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938273.450169:0:13790:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784938273.450172:0:13790:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cece6d800 00000020:00000080:0.0:1784938273.450175:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784938273.450240:0:13790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13790:1871643144216192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938273.451771:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938273.451832:0:13790:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc98c5900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938273.455389:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144216192 00000100:00100000:1.0:1784938273.455404:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144216192 00000100:00100000:1.0:1784938273.455459:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784938273.455482:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:13790:x1871643144216192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938273.455639:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:13790:x1871643144216192:12345-0@lo:502:llog_process_th.0 Request processed in 159us (3870us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.455647:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1784938273.455991:0:13790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13790:1871643144216192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938273.456024:0:13790:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938273.456031:0:13790:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938273.456033:0:13790:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784938273.456037:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1784938273.462084:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1784938273.462129:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938273.462142:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.462154:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938273.462165:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938273.462168:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cfd213000 from 7 10000000:01000000:1.0:1784938273.462171:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938273.462207:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.462238:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.462274:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938273.462299:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144216320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.462364:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938273.462411:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4da80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938273.462567:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144216320 00000100:00100000:2.0:1784938273.462574:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144216320 00000100:00100000:2.0:1784938273.462610:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1784938273.462617:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+21:6510:x1871643144216320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938273.462629:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938273.462640:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ee54c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee545 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938273.462667:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ee54c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee545 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938273.462677:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ee54c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee545 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938273.462686:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1400, rc 0) 00000100:00100000:2.0:1784938273.462722:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144216320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938273.462728:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1784938273.463370:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144216320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938273.463388:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.463397:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938273.463456:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144216448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.463491:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938273.463520:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4da80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938273.464067:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144216448 00000100:00100000:2.0:1784938273.464074:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144216448 00000100:00100000:2.0:1784938273.465884:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784938273.465904:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144216448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938273.466086:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144216448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (2594us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938273.466094:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1784938273.470876:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144216448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.471043:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144216576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.471122:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938273.471169:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4da80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938273.471241:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144216576 00000100:00100000:3.0:1784938273.471257:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144216576 00000100:00100000:3.0:1784938273.471324:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1784938273.471333:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144216576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.471460:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144216576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.471471:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1784938273.471695:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144216576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.472203:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13793:1871643144216704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938273.472281:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938273.472316:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938273.472463:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144216704 00000100:00100000:3.0:1784938273.472469:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144216704 00000100:00100000:3.0:1784938273.472507:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1784938273.472515:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:13793:x1871643144216704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938273.472614:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:13793:x1871643144216704:12345-0@lo:502:llog_process_th.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.472621:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784938273.472757:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13793:1871643144216704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938273.472781:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938273.472800:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938273.472803:0:13793:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784938273.472810:0:13793:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cfd213000 00000020:00000080:2.0:1784938273.472813:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784938273.472940:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938273.472944:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938273.472946:0:13793:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784938273.472948:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938273.472956:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938273.472958:0:13793:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784938273.472962:0:13793:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cfd213000 00000020:00000080:2.0:1784938273.472964:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000040:00080000:1.0:1784938273.478549:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784938273.481123:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13793:1871643144216832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938273.481210:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938273.481411:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc6063600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938273.481553:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144216832 00000100:00100000:1.0:1784938273.481561:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144216832 00000100:00100000:1.0:1784938273.481652:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1784938273.481661:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:13793:x1871643144216832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938273.481783:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:13793:x1871643144216832:12345-0@lo:502:llog_process_th.0 Request processed in 123us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.481803:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784938273.481890:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13793:1871643144216832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938273.481927:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938273.481936:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938273.481938:0:13793:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784938273.481942:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784938273.483015:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1784938273.483041:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938273.483052:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.483063:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938273.483072:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938273.483074:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cc481d800 from 7 10000000:01000000:3.0:1784938273.483076:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938273.483105:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.483112:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.483123:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938273.483154:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144216960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.483203:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938273.483479:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938273.483725:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144216960 00000100:00100000:1.0:1784938273.483731:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144216960 00000100:00100000:1.0:1784938273.483767:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1784938273.483775:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+22:6510:x1871643144216960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938273.483787:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938273.483808:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee55a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee553 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.483829:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee55a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee553 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.483839:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee55a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee553 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938273.483847:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0c00, rc 0) 00000100:00100000:1.0:1784938273.483885:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144216960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.483891:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1784938273.484036:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144216960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938273.484056:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.484064:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938273.484120:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.484147:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938273.484179:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938273.484192:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144217088 00000100:00100000:3.0:1784938273.484194:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144217088 00000100:00100000:3.0:1784938273.484233:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1784938273.484241:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144217088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.484469:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144217088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.484477:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1784938273.484507:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.484534:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.484576:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938273.484589:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938273.484605:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144217216 00000100:00100000:3.0:1784938273.484609:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144217216 00000100:00100000:3.0:1784938273.484625:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1784938273.484630:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144217216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.484702:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144217216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.484709:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1784938273.484744:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.484995:0:13795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13795:1871643144217344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938273.485028:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938273.485048:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144217344 00000100:00100000:3.0:1784938273.485051:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144217344 00000100:00100000:3.0:1784938273.485070:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1784938273.485076:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:13795:x1871643144217344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938273.485141:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:13795:x1871643144217344:12345-0@lo:502:llog_process_th.0 Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.485147:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1784938273.485174:0:13795:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc12ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938273.485185:0:13795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13795:1871643144217344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938273.485204:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938273.485464:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938273.485468:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784938273.485476:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cc481d800 00000020:00000080:3.0:1784938273.485479:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938273.485567:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938273.485571:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938273.485579:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784938273.485583:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938273.485586:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938273.485587:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784938273.485591:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cc481d800 00000020:00000080:3.0:1784938273.485593:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784938273.493626:0:13795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13795:1871643144217472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938273.493710:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938273.493761:0:13795:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc12ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938273.495743:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144217472 00000100:00100000:0.0:1784938273.495756:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144217472 00000100:00100000:0.0:1784938273.495819:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1784938273.495829:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:13795:x1871643144217472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938273.495987:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:13795:x1871643144217472:12345-0@lo:502:llog_process_th.0 Request processed in 159us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938273.495994:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1784938273.496172:0:13795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13795:1871643144217472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938273.496204:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938273.496240:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938273.496243:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784938273.496256:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1784938273.496687:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1784938273.496721:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938273.496731:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938273.496742:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938273.496752:0:6510:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938273.496754:0:6510:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cca3c9000 from 7 10000000:01000000:2.0:1784938273.496757:0:6510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938273.496786:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938273.496807:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938273.496816:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938273.496846:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938273.496892:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938273.497071:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d29540 going to sleep for 11 seconds 00000040:00080000:2.0:1784938273.499771:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784938273.500128:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144217600 00000100:00100000:3.0:1784938273.500140:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144217600 00000100:00100000:3.0:1784938273.500433:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1784938273.500445:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+23:6510:x1871643144217600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938273.500465:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938273.500484:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cd9247800/0x26783cd1c59ee568 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ee561 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.500511:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cd9247800/0x26783cd1c59ee568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ee561 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.500522:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cd9247800/0x26783cd1c59ee568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ee561 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.500532:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cd9247800, rc 0) 00000100:00100000:3.0:1784938273.500623:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144217600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.500629:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1784938273.500700:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938273.500717:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938273.500726:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938273.500807:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938273.500838:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938273.511440:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d29540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938273.513453:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144217728 00000100:00100000:1.0:1784938273.513470:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144217728 00000100:00100000:1.0:1784938273.513535:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1784938273.513552:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144217728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.513748:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144217728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (12908us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.513757:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1784938273.513837:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.513889:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.513933:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938273.513961:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf388e900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938273.513974:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144217856 00000100:00100000:1.0:1784938273.513977:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144217856 00000100:00100000:1.0:1784938273.513993:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1784938273.513998:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144217856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938273.514072:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:6510:x1871643144217856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938273.514078:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1784938273.514116:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7782ae5c-cb83-4240-bccc-1dc097db054d:6510:1871643144217856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938273.516753:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13799:1871643144217984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938273.516929:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938273.516966:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144217984 00000100:00100000:0.0:1784938273.516972:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144217984 00000100:00100000:0.0:1784938273.517021:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1784938273.517029:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:13799:x1871643144217984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938273.517155:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:13799:x1871643144217984:12345-0@lo:502:llog_process_th.0 Request processed in 126us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938273.517162:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1784938273.517239:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc98c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938273.517644:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13799:1871643144217984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938273.517676:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938273.517685:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938273.517688:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784938273.517693:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cca3c9000 00000020:00000080:0.0:1784938273.517696:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938273.517803:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938273.517808:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938273.517809:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784938273.517811:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938273.517814:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938273.517815:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784938273.517818:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cca3c9000 00000020:00000080:0.0:1784938273.517820:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784938273.524061:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13799:1871643144218112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938273.524148:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938273.524188:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144218112 00000100:00100000:0.0:1784938273.524195:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144218112 00000100:00100000:0.0:1784938273.524287:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1784938273.524296:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:13799:x1871643144218112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938273.524570:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:13799:x1871643144218112:12345-0@lo:502:llog_process_th.0 Request processed in 274us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938273.524579:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1784938273.524636:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc98c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938273.524658:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7782ae5c-cb83-4240-bccc-1dc097db054d:13799:1871643144218112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938273.524687:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938273.524694:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938273.524696:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784938273.524700:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784938273.524877:0:6510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1784938273.524902:0:6510:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938273.524912:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.524923:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938273.789085:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938273.789169:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125247744 00000100:00100000:3.0:1784938273.789178:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125247744 00000100:00100000:3.0:1784938273.789286:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 366 00000100:00100000:3.0:1784938273.789296:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:6166:x1871643125247744:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938273.789313:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938273.789332:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee56f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28639 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.789359:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee56f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28639 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.789371:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee56f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28639 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938273.789380:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cd9246200, rc 0) 00000100:00100000:3.0:1784938273.789440:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125247744:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 147us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.789447:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 366 00000100:00100000:3.0:1784938273.795808:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938273.796011:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125247872 00000100:00100000:0.0:1784938273.796021:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125247872 00000100:00100000:0.0:1784938273.796074:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 367 00000100:00100000:0.0:1784938273.796086:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125247872:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938273.796268:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125247872:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 183us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938273.796276:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 367 00000100:00100000:2.0:1784938273.804298:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938273.804365:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125248000 00000100:00100000:0.0:1784938273.804376:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125248000 00000100:00100000:0.0:1784938273.804651:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 368 00000100:00100000:0.0:1784938273.804662:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125248000:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938273.804829:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125248000:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 168us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938273.804837:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 368 00000100:00100000:1.0:1784938273.808555:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938273.808647:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125248128 00000100:00100000:3.0:1784938273.808657:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125248128 00000100:00100000:3.0:1784938273.808712:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 369 00000100:00100000:3.0:1784938273.808722:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:10786:x1871643125248128:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938273.808888:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:10786:x1871643125248128:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 167us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.808896:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 369 00000100:00100000:3.0:1784938273.819159:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938273.819289:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125248256 00000100:00100000:2.0:1784938273.819299:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125248256 00000100:00100000:2.0:1784938273.819354:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 370 00000100:00100000:2.0:1784938273.819363:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:10786:x1871643125248256:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938273.819533:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:10786:x1871643125248256:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 170us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938273.819541:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 370 00000100:00100000:2.0:1784938273.830566:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938273.831114:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125248384 00000100:00100000:0.0:1784938273.831126:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125248384 00000100:00100000:0.0:1784938273.831201:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 371 00000100:00100000:0.0:1784938273.831254:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:6166:x1871643125248384:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938273.831272:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938273.831291:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee576 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28640 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938273.831331:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28640 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938273.831343:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28640 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938273.831352:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76400, rc 0) 00000100:00100000:0.0:1784938273.831431:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125248384:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 211us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938273.831439:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 371 00000100:00100000:1.0:1784938273.840704:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938273.840954:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125248512 00000100:00100000:3.0:1784938273.840965:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125248512 00000100:00100000:3.0:1784938273.841021:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 372 00000100:00100000:3.0:1784938273.841032:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125248512:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938273.841191:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125248512:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 161us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.841199:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 372 00000100:00100000:3.0:1784938273.849856:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938273.849964:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125248640 00000100:00100000:2.0:1784938273.849973:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125248640 00000100:00100000:2.0:1784938273.850047:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 373 00000100:00100000:2.0:1784938273.850056:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125248640:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938273.850195:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:6166:x1871643125248640:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 140us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938273.850204:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 373 00000100:00100000:2.0:1784938273.857652:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938273.858067:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125248768 00000100:00100000:0.0:1784938273.858077:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125248768 00000100:00100000:0.0:1784938273.858135:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 374 00000100:00100000:0.0:1784938273.858145:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:10789:x1871643125248768:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938273.858347:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:10789:x1871643125248768:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 201us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938273.858354:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 374 00000100:00100000:1.0:1784938273.866719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938273.866881:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125248896 00000100:00100000:3.0:1784938273.866890:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125248896 00000100:00100000:3.0:1784938273.866960:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 375 00000100:00100000:3.0:1784938273.866970:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:10789:x1871643125248896:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938273.867141:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:10789:x1871643125248896:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 171us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938273.867148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 375 00010000:00010000:0.0:1784938274.401202:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938274.468543:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144218240:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938274.468876:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938274.468948:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144218240 00000100:00100000:0.0:1784938274.468955:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144218240 00000100:00100000:0.0:1784938274.469004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 151 00000100:00100000:0.0:1784938274.469013:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144218240:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938274.469048:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938274.469087:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144218240:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 75us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938274.469108:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 151 00000100:00100000:0.0:1784938274.469796:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144218240:192.168.203.126@tcp:41:osp-pre-0-1.0 00000040:00080000:2.0:1784938274.528038:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1784938274.528936:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784938275.429594:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938275.999654:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144218368:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938276.000317:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938276.000925:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144218368 00000100:00100000:3.0:1784938276.000934:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144218368 00000100:00100000:3.0:1784938276.000993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 152 00000100:00100000:3.0:1784938276.001003:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144218368:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938276.001039:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784938276.001096:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144218368:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 94us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938276.001103:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 152 00000100:00100000:0.0:1784938276.001407:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144218368:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:2.0:1784938276.447372:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938277.472836:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938277.502336:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938277.502381:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938277.502415:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938277.502453:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938277.502470:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938277.502488:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938277.502598:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125249152 00000100:00100000:3.0:1784938277.502607:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125249152 00000100:00100000:3.0:1784938277.502676:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125249664 00000100:00100000:3.0:1784938277.502680:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125249664 00000100:00100000:3.0:1784938277.502694:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125249280 00000100:00100000:3.0:1784938277.502696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125249280 00000100:00100000:3.0:1784938277.502706:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125249536 00000100:00100000:3.0:1784938277.502708:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125249536 00000100:00100000:3.0:1784938277.502723:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00100000:3.0:1784938277.502732:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125249152:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938277.502823:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125249152:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 92us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938277.502831:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00100000:3.0:1784938277.502849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:3.0:1784938277.502855:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125249664:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938277.502883:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125249664:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938277.502888:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:3.0:1784938277.502911:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00100000:3.0:1784938277.502930:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125249280:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938277.502954:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125249280:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938277.502960:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00100000:3.0:1784938277.502972:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00100000:3.0:1784938277.502977:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125249536:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938277.502999:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125249536:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938277.503005:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00100000:2.0:1784938277.503347:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125249024 00000100:00100000:2.0:1784938277.503352:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125249024 00000100:00100000:2.0:1784938277.503387:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 376 00000100:00100000:2.0:1784938277.503395:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125249024:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938277.503429:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125249024:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938277.503436:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 376 00000100:00080000:0.0:1784938277.503536:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938277.503540:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938277.503595:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125249408 00000100:00100000:1.0:1784938277.503600:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125249408 00000100:00100000:1.0:1784938277.503654:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:1.0:1784938277.503788:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125249408:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938277.503823:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125249408:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 162us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938277.503829:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00080000:0.0:1784938277.505178:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938277.536794:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144218496:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938277.536902:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144219008:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.536929:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144219520:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.536948:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144220032:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.536973:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1784938277.536979:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144218624:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938277.537000:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144219136:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.537017:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144219648:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.537055:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144220160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.537087:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144218880:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.537107:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144219392:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.537124:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144219904:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.537144:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1784938277.537152:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144218752:0@lo:400:kworker.0 00000100:00100000:0.0:1784938277.537192:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938277.537254:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144219264:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.537278:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144219776:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.537296:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144220288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.537322:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144218752 00000100:00100000:0.0:1784938277.537329:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144218752 00000100:00100000:0.0:1784938277.537370:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1784938277.537379:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144218752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938277.537454:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144218752:12345-0@lo:400:kworker.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938277.537461:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1784938277.537510:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144218752:0@lo:400:kworker.0 00000100:00100000:0.0:1784938277.537735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938277.537851:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938277.537881:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938277.537912:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938277.537931:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938277.537951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938277.537965:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144219008 00000100:00100000:3.0:1784938277.537972:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144219008 00000100:00100000:0.0:1784938277.537977:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938277.538000:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938277.538011:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 153 00000100:00100000:3.0:1784938277.538022:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144219008:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.538031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938277.538054:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938277.538079:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144219008:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 59us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938277.538095:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 153 00000100:00100000:3.0:1784938277.538120:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144219520 00000100:00100000:3.0:1784938277.538124:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144219520 00000100:00100000:3.0:1784938277.538155:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144220032 00000100:00100000:3.0:1784938277.538158:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144220032 00000100:00100000:3.0:1784938277.538169:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144219136 00000100:00100000:3.0:1784938277.538171:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144219136 00000100:00100000:3.0:1784938277.538180:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144219392 00000100:00100000:3.0:1784938277.538182:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144219392 00000100:00100000:3.0:1784938277.538190:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144218880 00000100:00100000:3.0:1784938277.538192:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144218880 00000100:00100000:3.0:1784938277.538200:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 257 00000100:00100000:3.0:1784938277.538239:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144219520:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938277.538401:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144219648 00000100:00100000:2.0:1784938277.538406:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144219648 00000100:00100000:2.0:1784938277.538444:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144220160 00000100:00100000:2.0:1784938277.538454:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144220160 00000100:00100000:2.0:1784938277.538477:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 99 00000100:00100000:2.0:1784938277.538485:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144219648:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.538590:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938277.538598:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144218496 00000100:00100000:1.0:1784938277.538605:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144218496 00000100:00100000:0.0:1784938277.538609:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938277.538638:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938277.538643:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144218624 00000100:00100000:1.0:1784938277.538647:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144218624 00000100:00100000:0.0:1784938277.538661:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938277.538671:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 112 00000100:00100000:1.0:1784938277.538680:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144218496:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938277.538706:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938277.538706:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144219776 00000100:00100000:1.0:1784938277.538749:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144218496:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 71us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938277.538756:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 112 00000100:00100000:1.0:1784938277.538782:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 113 00000100:00100000:1.0:1784938277.538789:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144218624:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938277.538800:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938277.538821:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144218624:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 32us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938277.538827:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 113 00000100:00100000:1.0:1784938277.538845:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144219904 00000100:00100000:1.0:1784938277.538849:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144219904 00000100:00100000:1.0:1784938277.538867:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 258 00000100:00100000:1.0:1784938277.538873:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144220032:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938277.538910:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144220032:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 36us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938277.538917:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 258 00000100:00100000:0.0:1784938277.538923:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144219776 00000100:00100000:1.0:1784938277.538934:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 259 00000100:00100000:1.0:1784938277.538944:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144219136:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.538952:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144220288 00000100:00100000:0.0:1784938277.538957:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144220288 00000100:00100000:1.0:1784938277.538971:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144219136:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 29us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938277.538978:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 100 00000100:00100000:0.0:1784938277.538989:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144220160:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.539021:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144220160:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938277.539028:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 100 00000100:00100000:0.0:1784938277.539043:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 101 00000100:00100000:0.0:1784938277.539049:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144219776:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.539073:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144219776:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938277.539079:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 101 00000100:00100000:0.0:1784938277.539091:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 102 00000100:00100000:0.0:1784938277.539097:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144220288:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.539454:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144220288:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 357us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938277.539461:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 102 00000100:00100000:0.0:1784938277.539505:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144219008:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.539826:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144218624:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938277.539841:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144219136:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.539851:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144220160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.539863:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144218496:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00080000:0.0:1784938277.539878:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb67100 x1871643144220032/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938277.539889:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144220032:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938277.539922:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731f80 x1871643144219776/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938277.539932:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144219776:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.539940:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144220288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.540043:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144219264 00000100:00100000:0.0:1784938277.540047:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144219264 00000100:00100000:0.0:1784938277.540076:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 154 00000100:00100000:0.0:1784938277.540082:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144219264:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.540131:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144219264:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 49us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938277.540145:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 154 00000100:00100000:0.0:1784938277.540161:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1784938277.540167:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1784938277.540266:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144219264:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.540531:0:9526:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784938277.541935:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144219520:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 3691us (4045us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938277.543039:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144219648:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 4549us (5057us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938277.543050:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 99 00000100:00100000:1.0:1784938277.543096:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 259 00000100:00080000:2.0:1784938277.543120:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938277.543142:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938277.543146:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938277.543149:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938277.543303:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 260 00000100:00100000:0.0:1784938277.543320:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144219392:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.543372:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144219392:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 61us (5347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938277.543379:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 260 00000100:00100000:0.0:1784938277.543402:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 261 00000100:00100000:0.0:1784938277.543409:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144218880:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.543433:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144218880:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (5378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938277.543439:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 261 00000100:00100000:0.0:1784938277.543451:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 262 00000100:00100000:0.0:1784938277.543458:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144219904:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.543480:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144219904:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (4892us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938277.543487:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 262 00010000:00080000:0.0:1784938277.543748:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd730a80 x1871643144219648/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938277.543781:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144219648:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938277.543814:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731880 x1871643144219520/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938277.543824:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144219520:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.543881:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144218880:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.543893:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144219392:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938277.543904:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144219904:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938277.544742:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 257 00000001:00080000:0.0:1784938278.057056:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1784938278.495426:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938278.560918:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144220416:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938278.562023:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938278.562109:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144220416 00000100:00100000:1.0:1784938278.562123:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144220416 00000100:00100000:0.0:1784938278.562150:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144220544:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938278.562185:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 114 00000100:00100000:1.0:1784938278.562199:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144220416:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938278.562261:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938278.562313:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144220416:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938278.562323:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 114 00000100:00100000:0.0:1784938278.562683:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938278.562723:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144220544 00000100:00100000:1.0:1784938278.562730:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144220544 00000100:00100000:1.0:1784938278.562781:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 115 00000100:00100000:1.0:1784938278.562793:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144220544:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938278.562807:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938278.562849:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144220544:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 60us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938278.562856:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 115 00010000:00080000:2.0:1784938278.563010:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7ddb800 x1871643144220544/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938278.563040:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144220544:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00080000:3.0:1784938278.570595:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb24380 x1871643144220416/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938278.570634:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144220416:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00010000:2.0:1784938279.519429:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938279.583716:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938279.583765:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144220672:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938279.584318:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938279.584398:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144220672 00000100:00100000:0.0:1784938279.584408:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144220672 00000100:00100000:0.0:1784938279.584481:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 155 00000100:00100000:0.0:1784938279.584492:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144220672:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938279.584536:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938279.584590:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144220672:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 100us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938279.584599:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 155 00000100:00100000:1.0:1784938279.584937:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144220672:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:0.0:1784938280.544160:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938281.121932:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144220800:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938281.123314:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938281.123406:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144220800 00000100:00100000:0.0:1784938281.123447:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144220800 00000100:00100000:0.0:1784938281.123523:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 156 00000100:00100000:0.0:1784938281.123535:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144220800:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938281.123586:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938281.123663:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144220800:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 130us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938281.123670:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 156 00000100:00100000:3.0:1784938281.124329:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144220800:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:3.0:1784938281.567508:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938282.591505:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938282.615377:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938282.615669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125249792 00000100:00100000:0.0:1784938282.615688:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125249792 00000100:00100000:0.0:1784938282.615795:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 378 00000100:00100000:0.0:1784938282.615805:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125249792:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.615893:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125249792:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 90us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.615900:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 378 00000100:00100000:3.0:1784938282.617926:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938282.617975:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938282.617997:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938282.618016:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938282.618059:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938282.618102:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125250176 00000100:00100000:3.0:1784938282.618114:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125250176 00000100:00100000:3.0:1784938282.618175:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:3.0:1784938282.618185:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125250176:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938282.618285:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125250176:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938282.618292:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:3.0:1784938282.618327:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125249920 00000100:00100000:3.0:1784938282.618330:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125249920 00000100:00100000:3.0:1784938282.618356:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125250048 00000100:00100000:3.0:1784938282.618359:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125250048 00000100:00100000:3.0:1784938282.618372:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125250432 00000100:00100000:3.0:1784938282.618375:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125250432 00000100:00100000:3.0:1784938282.618386:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125250304 00000100:00100000:3.0:1784938282.618388:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125250304 00000100:00100000:3.0:1784938282.618402:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 263 00000100:00100000:3.0:1784938282.618408:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125249920:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938282.618439:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125249920:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938282.618458:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 263 00000100:00100000:3.0:1784938282.618470:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 264 00000100:00100000:3.0:1784938282.618477:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125250048:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938282.618513:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125250048:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938282.618519:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 264 00000100:00100000:3.0:1784938282.618531:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 265 00000100:00100000:3.0:1784938282.618537:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125250432:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938282.618576:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125250432:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 39us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938282.618583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 265 00000100:00100000:3.0:1784938282.618595:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 266 00000100:00100000:3.0:1784938282.618601:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125250304:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938282.618625:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125250304:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938282.618637:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 266 00000100:00080000:3.0:1784938282.618658:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938282.618661:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938282.618664:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938282.658587:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144220928:0@lo:400:kworker.0 00000100:00100000:0.0:1784938282.658661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938282.658720:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144221440:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.658788:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144221952:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.658820:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144222464:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.658852:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784938282.658859:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144221312:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.658884:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144221824:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.658906:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144222336:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.658957:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144221056:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.658982:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144221568:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.659002:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144222080:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.659022:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784938282.659027:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144221184:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.659045:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144221696:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.659060:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144222208:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.659087:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144220928 00000100:00100000:0.0:1784938282.659094:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144220928 00000100:00100000:0.0:1784938282.659134:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1784938282.659142:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144220928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938282.659190:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144220928:12345-0@lo:400:kworker.0 Request processed in 49us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.659198:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1784938282.659459:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659544:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659562:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659594:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659617:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659632:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659645:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659673:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659701:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659719:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659751:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938282.659769:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144221952 00000100:00100000:0.0:1784938282.659774:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144221952 00000100:00100000:0.0:1784938282.659803:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144222464 00000100:00100000:0.0:1784938282.659806:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144222464 00000100:00100000:0.0:1784938282.659819:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144221824 00000100:00100000:0.0:1784938282.659821:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144221824 00000100:00100000:0.0:1784938282.659835:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144222336 00000100:00100000:0.0:1784938282.659837:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144222336 00000100:00100000:0.0:1784938282.659851:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 104 00000100:00100000:0.0:1784938282.659857:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144221952:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.659894:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144221952:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.659901:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 104 00000100:00100000:0.0:1784938282.659913:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 105 00000100:00100000:0.0:1784938282.659919:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144222464:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.659942:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144222464:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.659947:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 105 00000100:00100000:0.0:1784938282.659957:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 106 00000100:00100000:0.0:1784938282.659963:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144221824:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.659980:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144221824:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 17us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.659985:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 106 00000100:00100000:0.0:1784938282.659993:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 107 00000100:00100000:0.0:1784938282.660006:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144222336:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660027:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144222336:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.660033:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 107 00000100:00100000:0.0:1784938282.660049:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144221440 00000100:00100000:0.0:1784938282.660053:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144221440 00000100:00100000:0.0:1784938282.660072:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144221184 00000100:00100000:0.0:1784938282.660074:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144221184 00000100:00100000:0.0:1784938282.660086:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 157 00000100:00100000:0.0:1784938282.660091:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144221440:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660116:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144221440:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.660123:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 157 00000100:00100000:0.0:1784938282.660133:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 158 00000100:00100000:0.0:1784938282.660139:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144221184:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660159:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144221184:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.660164:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 158 00000100:00100000:0.0:1784938282.660432:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144221184:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938282.660466:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb66d80 x1871643144221824/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938282.660476:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144221824:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660487:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144222336:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660511:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144220928:0@lo:400:kworker.0 00000100:00100000:0.0:1784938282.660522:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144221440:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938282.660533:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd732d80 x1871643144221952/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938282.660542:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144221952:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660550:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1784938282.660555:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910cffb55500, transno 4294967301 00000100:00100000:0.0:1784938282.660565:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144222464:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660628:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144221312 00000100:00100000:0.0:1784938282.660632:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144221312 00000100:00100000:0.0:1784938282.660652:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 267 00000100:00100000:0.0:1784938282.660658:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144221312:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660705:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144221312:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 47us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.660712:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 267 00000100:00100000:0.0:1784938282.660722:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144221056 00000100:00100000:0.0:1784938282.660725:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144221056 00000100:00100000:0.0:1784938282.660754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144221568 00000100:00100000:0.0:1784938282.660757:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144221568 00000100:00100000:0.0:1784938282.660769:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144222080 00000100:00100000:0.0:1784938282.660771:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144222080 00000100:00100000:0.0:1784938282.660780:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144221696 00000100:00100000:0.0:1784938282.660782:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144221696 00000100:00100000:0.0:1784938282.660791:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144222208 00000100:00100000:0.0:1784938282.660794:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144222208 00000100:00100000:0.0:1784938282.660818:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 268 00000100:00100000:0.0:1784938282.660823:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144221056:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660849:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144221056:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.660855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 268 00000100:00100000:0.0:1784938282.660867:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 269 00000100:00100000:0.0:1784938282.660873:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144221568:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660895:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144221568:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.660900:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 269 00000100:00100000:0.0:1784938282.660911:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 270 00000100:00100000:0.0:1784938282.660916:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144222080:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660936:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144222080:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.660942:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 270 00000100:00100000:0.0:1784938282.660952:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 271 00000100:00100000:0.0:1784938282.660957:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144221696:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.660975:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144221696:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.660981:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 271 00000100:00100000:0.0:1784938282.660990:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 272 00000100:00100000:0.0:1784938282.660995:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144222208:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.661013:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144222208:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938282.661025:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 272 00010000:00080000:0.0:1784938282.661185:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb67100 x1871643144221696/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938282.661195:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144221696:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938282.661205:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731880 x1871643144222208/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938282.661234:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144222208:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.661247:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144221056:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.661256:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144221568:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.661265:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144222080:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938282.661297:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144221312:192.168.203.126@tcp:400:kworker.0 00000100:00080000:0.0:1784938282.661340:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938282.661344:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938282.661347:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938282.661349:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938282.664250:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938282.664276:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144222592:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938282.664806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938282.664854:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144222592 00000100:00100000:2.0:1784938282.664861:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144222592 00000100:00100000:2.0:1784938282.664904:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 116 00000100:00100000:2.0:1784938282.664912:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144222592:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938282.664940:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938282.664981:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144222592:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 69us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938282.664988:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 116 00000100:00100000:1.0:1784938282.665240:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144222592:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938282.666166:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144222720:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938282.666367:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938282.666389:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144222720 00000100:00100000:2.0:1784938282.666395:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144222720 00000100:00100000:2.0:1784938282.666442:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 117 00000100:00100000:2.0:1784938282.666450:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144222720:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938282.666468:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938282.666502:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144222720:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 52us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938282.666509:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 117 00000100:00100000:1.0:1784938282.672671:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144222720:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00010000:0.0:1784938283.619136:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938283.680670:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144222848:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938283.683667:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144222976:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938283.685210:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938283.685262:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938283.685293:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144222976 00000100:00100000:0.0:1784938283.685293:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144222848 00000100:00100000:2.0:1784938283.685300:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144222976 00000100:00100000:0.0:1784938283.685301:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144222848 00000100:00100000:2.0:1784938283.685347:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 118 00000100:00100000:2.0:1784938283.685357:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144222976:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938283.685396:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938283.685440:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144222976:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 86us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938283.685447:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 118 00010000:00080000:3.0:1784938283.685882:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd459180 x1871643144222976/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938283.685916:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144222976:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938283.687611:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 119 00000100:00100000:0.0:1784938283.687628:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144222848:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938283.687652:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938283.687729:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144222848:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 99us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938283.687750:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 119 00010000:00080000:0.0:1784938283.689245:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb78a80 x1871643144222848/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938283.689268:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144222848:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00010000:3.0:1784938284.644266:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938284.703697:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938284.703732:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144223104:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938284.704071:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938284.704140:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144223104 00000100:00100000:0.0:1784938284.704148:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144223104 00000100:00100000:0.0:1784938284.704201:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 159 00000100:00100000:0.0:1784938284.704211:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144223104:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938284.704279:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784938284.704497:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144223104:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 286us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938284.704505:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 159 00000100:00100000:1.0:1784938284.705898:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144223104:192.168.203.126@tcp:41:osp-pre-0-1.0 00000040:00080000:1.0:1784938284.767920:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1784938284.768646:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784938285.663399:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938286.239473:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938286.239498:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144223232:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938286.240379:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938286.240464:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144223232 00000100:00100000:2.0:1784938286.240472:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144223232 00000100:00100000:2.0:1784938286.240522:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 160 00000100:00100000:2.0:1784938286.240532:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144223232:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:2.0:1784938286.240568:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784938286.240759:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144223232:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 226us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938286.240767:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 160 00000100:00100000:0.0:1784938286.243390:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144223232:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938286.687434:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938287.711557:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938287.740275:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938287.740404:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125250560 00000100:00100000:0.0:1784938287.740416:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125250560 00000100:00100000:0.0:1784938287.740494:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 380 00000100:00100000:0.0:1784938287.740503:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125250560:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.740574:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125250560:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 72us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938287.740797:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 380 00000100:00100000:1.0:1784938287.741723:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938287.741763:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938287.742097:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125250816 00000100:00100000:3.0:1784938287.742106:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125250816 00000100:00100000:0.0:1784938287.742707:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125250688 00000100:00100000:0.0:1784938287.742713:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125250688 00000100:00100000:0.0:1784938287.742752:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 273 00000100:00100000:0.0:1784938287.742777:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125250816:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:1.0:1784938287.743005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938287.743010:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938287.743028:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 274 00000100:00100000:1.0:1784938287.743038:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125250688:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.743872:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125250816:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1094us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938287.743882:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 273 00000100:00100000:1.0:1784938287.752068:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125250688:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 9019us (10291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938287.752084:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 274 00000100:00100000:3.0:1784938287.758603:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938287.758655:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938287.758683:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938287.758758:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125251072 00000100:00100000:3.0:1784938287.758770:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125251072 00000100:00100000:0.0:1784938287.759055:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125250944 00000100:00100000:0.0:1784938287.759060:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125250944 00000100:00100000:0.0:1784938287.759106:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:0.0:1784938287.759117:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2391:x1871643125250944:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:0.0:1784938287.759156:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee49d 00000100:00080000:0.0:1784938287.759166:0:8431:0:(import.c:65:import_set_state_nolock()) ffff910cffbc8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938287.759273:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1784938287.759573:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125251200 00000100:00100000:3.0:1784938287.759577:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125251200 00000100:00100000:3.0:1784938287.759611:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 275 00000100:00100000:3.0:1784938287.759620:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125251072:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938287.759652:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 276 00000100:00100000:1.0:1784938287.759678:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125251200:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.759714:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125251072:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 80us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.759725:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 275 00000100:00100000:1.0:1784938287.759781:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125251200:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 111us (1091us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938287.759789:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938287.759792:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 276 00000100:00080000:3.0:1784938287.760147:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938287.760154:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938287.760156:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938287.761060:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+2:2391:x1871643125250944:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 1937us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938287.761073:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:3.0:1784938287.777432:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144223488:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938287.777564:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938287.777571:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144223360:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938287.777766:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938287.777844:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144223488 00000100:00100000:1.0:1784938287.777852:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144223488 00000100:00100000:3.0:1784938287.777855:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938287.777897:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144223360 00000100:00100000:1.0:1784938287.777910:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144223360 00000100:00100000:1.0:1784938287.777931:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 120 00000100:00100000:1.0:1784938287.777940:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144223488:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938287.777969:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938287.778018:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144223488:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938287.778025:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 120 00000100:00100000:1.0:1784938287.778042:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 121 00000100:00100000:1.0:1784938287.778048:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144223360:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938287.778057:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938287.778076:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144223360:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938287.778082:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 121 00000100:00080000:1.0:1784938287.778097:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938287.778726:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144223360:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938287.778741:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144223488:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938287.779497:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144223616:0@lo:400:kworker.0 00000100:00100000:0.0:1784938287.779560:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938287.779598:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144224128:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.779649:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144224640:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.779679:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784938287.779685:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144223744:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.779723:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144224256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.779744:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144224768:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.780005:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.780031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.780051:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.780066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.780085:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.780105:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144223744 00000100:00100000:3.0:1784938287.780110:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144223744 00000100:00100000:3.0:1784938287.780145:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144224256 00000100:00100000:3.0:1784938287.780148:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144224256 00000100:00100000:3.0:1784938287.780168:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144224768 00000100:00100000:3.0:1784938287.780171:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144224768 00000100:00100000:3.0:1784938287.780186:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 277 00000100:00100000:3.0:1784938287.780192:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144223744:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.780262:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144223744:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 69us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.780269:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 277 00000100:00100000:3.0:1784938287.780286:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 278 00000100:00100000:3.0:1784938287.780292:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144224256:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.780312:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144224256:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.780326:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 278 00000100:00100000:3.0:1784938287.780338:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 279 00000100:00100000:3.0:1784938287.780344:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144224768:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.780366:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144224768:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.780371:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 279 00000100:00100000:2.0:1784938287.780714:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144223616 00000100:00100000:2.0:1784938287.780719:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144223616 00000100:00100000:2.0:1784938287.780756:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1784938287.780772:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144223616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938287.780811:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144223616:12345-0@lo:400:kworker.0 Request processed in 41us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938287.780818:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1784938287.780955:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144224640 00000100:00100000:1.0:1784938287.780960:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144224640 00000100:00100000:1.0:1784938287.781000:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 108 00000100:00100000:1.0:1784938287.781008:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144224640:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938287.781050:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144224640:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 43us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938287.781056:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 108 00000100:00100000:1.0:1784938287.781082:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144223872:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938287.781119:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144224384:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938287.781143:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144224896:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938287.781166:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784938287.781173:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144224000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938287.781196:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144224512:192.168.203.126@tcp:400:kworker.0 00000100:00080000:1.0:1784938287.781251:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938287.781255:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938287.781455:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.781477:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.781520:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.781544:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.781560:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938287.781578:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144224512 00000100:00100000:3.0:1784938287.781582:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144224512 00000100:00100000:3.0:1784938287.781612:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 109 00000100:00100000:3.0:1784938287.781619:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144224512:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.781650:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144224512:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.781657:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 109 00000100:00100000:3.0:1784938287.781674:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144224128 00000100:00100000:3.0:1784938287.781677:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144224128 00000100:00100000:3.0:1784938287.781706:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144223872 00000100:00100000:3.0:1784938287.781709:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144223872 00000100:00100000:3.0:1784938287.781721:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 161 00000100:00100000:3.0:1784938287.781726:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144224128:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.781751:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144224128:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.781763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 161 00000100:00100000:3.0:1784938287.781776:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 162 00000100:00100000:3.0:1784938287.781781:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144223872:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.781806:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144223872:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.781812:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 162 00000100:00100000:3.0:1784938287.781828:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144224384 00000100:00100000:3.0:1784938287.781831:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144224384 00000100:00100000:3.0:1784938287.781852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144224896 00000100:00100000:3.0:1784938287.781855:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144224896 00000100:00100000:3.0:1784938287.781867:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144224000 00000100:00100000:3.0:1784938287.781869:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144224000 00000100:00100000:3.0:1784938287.781880:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 280 00000100:00100000:3.0:1784938287.781886:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144224384:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.781909:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144224384:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.781916:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 280 00000100:00100000:3.0:1784938287.781927:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 281 00000100:00100000:3.0:1784938287.781933:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144224896:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.781956:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144224896:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.781963:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 281 00000100:00100000:3.0:1784938287.781974:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 282 00000100:00100000:3.0:1784938287.781981:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144224000:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938287.782013:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144224000:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938287.782020:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 282 00000100:00080000:1.0:1784938287.782292:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938287.782296:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938287.782331:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144224000:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938287.782346:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffc37800 x1871643144224512/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938287.782357:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144224512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938287.782368:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144223872:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938287.782388:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffc37100 x1871643144224384/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938287.782397:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144224384:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938287.782406:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffc36a00 x1871643144224896/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938287.782414:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144224896:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.782594:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144223744:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.782618:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144224256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.782629:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144224768:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938287.782639:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144223616:0@lo:400:kworker.0 00000100:00100000:0.0:1784938287.782649:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144224128:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938287.782661:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffc36d80 x1871643144224640/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938287.782669:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144224640:192.168.203.126@tcp:400:kworker.0 00010000:00010000:0.0:1784938288.737078:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938288.799651:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144225024:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938288.799974:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938288.800038:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144225024 00000100:00100000:1.0:1784938288.800047:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144225024 00000100:00100000:1.0:1784938288.800099:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 122 00000100:00100000:1.0:1784938288.800110:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144225024:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938288.800139:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938288.800180:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144225024:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938288.800187:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 122 00010000:00080000:1.0:1784938288.800337:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffc34380 x1871643144225024/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938288.800355:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144225024:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938288.802772:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144225152:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938288.803059:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938288.803089:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144225152 00000100:00100000:1.0:1784938288.803096:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144225152 00000100:00100000:1.0:1784938288.803145:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 123 00000100:00100000:1.0:1784938288.803155:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144225152:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938288.803189:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938288.803248:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144225152:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 94us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938288.803256:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 123 00010000:00080000:2.0:1784938288.816737:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7dc1c00 x1871643144225152/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938288.816840:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144225152:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:3.0:1784938289.762335:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938289.823628:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144225280:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938289.824099:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938289.824242:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144225280 00000100:00100000:3.0:1784938289.824250:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144225280 00000100:00100000:3.0:1784938289.824316:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 163 00000100:00100000:3.0:1784938289.824325:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144225280:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938289.824372:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784938289.824419:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144225280:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938289.824426:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 163 00000100:00100000:2.0:1784938289.824700:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144225280:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:3.0:1784938290.783414:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938291.359994:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144225408:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938291.360463:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938291.360540:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144225408 00000100:00100000:3.0:1784938291.360548:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144225408 00000100:00100000:3.0:1784938291.360642:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 164 00000100:00100000:3.0:1784938291.360652:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144225408:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938291.360695:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784938291.367783:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144225408:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 7118us (7307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938291.367799:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 164 00000100:00100000:3.0:1784938291.369579:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144225408:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938291.809333:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938292.834870:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938292.861512:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938292.861580:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125251328 00000100:00100000:2.0:1784938292.861590:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125251328 00000100:00100000:2.0:1784938292.861654:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 382 00000100:00100000:2.0:1784938292.861673:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2394:x1871643125251328:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938292.861923:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2394:x1871643125251328:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 260us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938292.861932:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 382 00000100:00100000:0.0:1784938292.862478:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938292.862556:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125251584 00000100:00100000:3.0:1784938292.862562:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125251584 00000100:00100000:3.0:1784938292.862615:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 283 00000100:00100000:3.0:1784938292.862624:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125251584:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.862634:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938292.862653:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00080000:2.0:1784938292.863635:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938292.863679:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125251840 00000100:00100000:2.0:1784938292.863686:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125251840 00000100:00100000:2.0:1784938292.863729:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125251456 00000100:00100000:2.0:1784938292.863732:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125251456 00000100:00100000:2.0:1784938292.863751:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 284 00000100:00100000:2.0:1784938292.863759:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125251840:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.868352:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938292.868435:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125251712 00000100:00100000:0.0:1784938292.868445:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125251712 00000100:00100000:0.0:1784938292.868508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 285 00000100:00100000:0.0:1784938292.868519:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125251456:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.868613:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125251456:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 96us (5958us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938292.868638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 285 00000100:00100000:0.0:1784938292.868656:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 286 00000100:00100000:0.0:1784938292.868674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125251712:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.868704:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125251712:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 42us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938292.868710:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 286 00000100:00080000:0.0:1784938292.868753:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938292.868757:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938292.870373:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125251840:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 6604us (7727us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938292.870387:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 284 00000100:00100000:3.0:1784938292.870731:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125251584:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 8105us (8252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938292.870739:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 283 00000100:00100000:1.0:1784938292.896168:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144225536:0@lo:400:kworker.0 00000100:00100000:0.0:1784938292.896186:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144225920:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.901896:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144225792:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938292.903105:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144225664:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.904469:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938292.904517:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144226432:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.904522:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144226048:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.904587:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144226944:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.904588:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144226560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.904641:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144227072:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.904850:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938292.904919:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938292.904955:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938292.904991:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938292.905024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938292.905314:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144226176:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938292.905341:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144226688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938292.905368:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144227200:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938292.905398:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938292.905404:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144227328:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938292.905460:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144225536 00000100:00100000:2.0:1784938292.905468:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144225536 00000100:00100000:2.0:1784938292.905508:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1784938292.905516:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144225536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938292.905569:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cecf8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144225536:12345-0@lo:400:kworker.0 Request processed in 53us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938292.905575:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1784938292.906338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938292.906389:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938292.906412:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144227200 00000100:00100000:1.0:1784938292.906417:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144227200 00000100:00100000:1.0:1784938292.906457:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 124 00000100:00100000:1.0:1784938292.906465:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144227200:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938292.906490:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938292.906532:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144227200:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 67us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938292.906539:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 124 00000100:00100000:1.0:1784938292.907436:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144225536:0@lo:400:kworker.0 00000100:00100000:1.0:1784938292.907496:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144226048 00000100:00100000:1.0:1784938292.907514:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144226048 00000100:00100000:1.0:1784938292.907547:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 165 00000100:00100000:1.0:1784938292.907555:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144226048:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.907606:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144226048:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 52us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938292.907614:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 165 00000100:00100000:1.0:1784938292.907635:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144225920 00000100:00100000:1.0:1784938292.907639:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144225920 00000100:00100000:1.0:1784938292.907683:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144226176 00000100:00100000:1.0:1784938292.907686:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144226176 00000100:00100000:1.0:1784938292.907710:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 287 00000100:00100000:1.0:1784938292.907716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144225920:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.907741:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144225920:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938292.907747:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 287 00000100:00100000:1.0:1784938292.907759:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 288 00000100:00100000:1.0:1784938292.907765:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144226176:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.907863:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144226176:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 97us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938292.907870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 288 00000100:00100000:1.0:1784938292.907966:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938292.913045:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144226304:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.913091:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144226816:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.913834:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938292.913860:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938292.913879:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938292.913905:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144225792 00000100:00100000:3.0:1784938292.913912:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144225792 00000100:00100000:3.0:1784938292.913955:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 166 00000100:00100000:3.0:1784938292.913963:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144225792:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.914016:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144225792:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938292.914023:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 166 00000100:00100000:3.0:1784938292.914046:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144226304 00000100:00100000:3.0:1784938292.914050:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144226304 00000100:00100000:3.0:1784938292.914070:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144226816 00000100:00100000:3.0:1784938292.914073:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144226816 00000100:00100000:3.0:1784938292.914087:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 289 00000100:00100000:3.0:1784938292.914092:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144226304:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.914131:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144226304:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 38us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938292.914137:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 289 00000100:00100000:3.0:1784938292.914150:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 290 00000100:00100000:3.0:1784938292.914156:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144226816:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.914178:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144226816:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938292.914184:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 290 00000100:00100000:3.0:1784938292.914486:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144227200:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938292.914686:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144226432 00000100:00100000:0.0:1784938292.914691:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144226432 00000100:00100000:0.0:1784938292.914724:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144226944 00000100:00100000:0.0:1784938292.914727:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144226944 00000100:00100000:0.0:1784938292.914738:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144227072 00000100:00100000:0.0:1784938292.914741:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144227072 00000100:00100000:0.0:1784938292.914756:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 110 00000100:00100000:0.0:1784938292.914763:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144226432:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.914801:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144226432:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 39us (9882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938292.914817:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 110 00000100:00100000:0.0:1784938292.914832:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 111 00000100:00100000:0.0:1784938292.914837:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144226944:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.914861:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144226944:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (9874us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938292.914866:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 111 00000100:00100000:0.0:1784938292.914875:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 112 00000100:00100000:0.0:1784938292.914881:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144227072:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.914900:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144227072:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 19us (9877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938292.914905:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 112 00000100:00080000:0.0:1784938292.914933:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938292.914937:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938292.914940:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938292.914942:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938292.915078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:0.0:1784938292.915100:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2048700 x1871643144226432/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938292.915115:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144226432:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.915118:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938292.915135:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144226944:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.915150:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938292.915161:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144226560 00000100:00100000:0.0:1784938292.915167:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144226560 00000100:00100000:0.0:1784938292.915206:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 113 00000100:00100000:0.0:1784938292.915247:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144226560:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.915285:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144225792:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938292.915298:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2048000 x1871643144226304/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938292.915315:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144226304:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938292.915326:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd204b100 x1871643144226816/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938292.915335:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144226816:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.915359:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144227328 00000100:00100000:1.0:1784938292.915362:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144227328 00000100:00100000:1.0:1784938292.915387:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 125 00000100:00100000:1.0:1784938292.915394:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144227328:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938292.915409:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938292.915431:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144225664 00000100:00100000:3.0:1784938292.915437:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144225664 00000100:00100000:1.0:1784938292.915443:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144227328:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 47us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938292.915450:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 125 00000100:00100000:3.0:1784938292.915469:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144226688 00000100:00100000:3.0:1784938292.915474:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144226688 00000100:00100000:1.0:1784938292.915488:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144226176:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.915504:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 291 00000100:00100000:3.0:1784938292.915512:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144225664:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.915519:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 292 00000100:00100000:1.0:1784938292.915529:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144226688:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.915544:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144225664:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938292.915551:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 291 00000100:00100000:1.0:1784938292.915566:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144226688:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938292.915573:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 292 00000100:00100000:1.0:1784938292.915612:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144226048:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938292.915626:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144227072:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938292.915719:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144226560:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 504us (7752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938292.915726:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 113 00000100:00080000:0.0:1784938292.915745:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938292.915748:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938292.915771:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144225920:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938292.915822:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd204a300 x1871643144226560/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938292.915834:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144226560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.916037:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144227328:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938292.916048:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144225664:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938292.916058:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144226688:192.168.203.126@tcp:400:kworker.0 00010000:00010000:0.0:1784938293.858476:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938293.921984:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144227456:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938293.922093:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938293.922102:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144227584:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938293.924038:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938293.924154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938293.924191:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144227456 00000100:00100000:1.0:1784938293.924200:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144227456 00000100:00100000:1.0:1784938293.924258:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144227584 00000100:00100000:1.0:1784938293.924261:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144227584 00000100:00100000:1.0:1784938293.924283:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 126 00000100:00100000:1.0:1784938293.924292:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144227456:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938293.924322:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938293.924374:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144227456:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 83us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938293.924394:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 126 00000100:00100000:1.0:1784938293.924414:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 127 00000100:00100000:1.0:1784938293.924913:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144227584:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938293.924927:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938293.925001:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144227584:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 580us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938293.925008:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 127 00010000:00080000:2.0:1784938293.925200:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7dc3480 x1871643144227584/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938293.925245:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144227584:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00080000:2.0:1784938293.925259:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7768380 x1871643144227456/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938293.925272:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144227456:192.168.203.126@tcp:13:osp-pre-0-1.0 00000001:00100000:2.0:1784938293.926392:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:2.0:1784938293.926398:0:9509:0:(genops.c:906:class_export_put()) final put ffff910cffbcb800/263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:2.0:1784938293.926432:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff910cffbcb800/263deb07-6496-49f7-9596-7a44f1bd8c2b for lustre-OST0001 00000020:00000080:2.0:1784938293.926470:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cffbc8800 for lustre-OST0001 00010000:00010000:3.0:1784938294.879438:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938294.945441:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144227712:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938294.946417:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938294.948203:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144227712 00000100:00100000:3.0:1784938294.948238:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144227712 00000100:00100000:3.0:1784938294.948295:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 167 00000100:00100000:3.0:1784938294.948313:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144227712:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938294.948346:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784938294.948442:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144227712:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 140us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938294.948450:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 167 00000100:00100000:3.0:1784938294.948791:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144227712:192.168.203.126@tcp:41:osp-pre-0-1.0 00000040:00080000:0.0:1784938295.008099:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1784938295.008399:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784938295.908462:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938296.483608:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938296.483635:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144227840:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938296.483968:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938296.490281:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144227840 00000100:00100000:3.0:1784938296.490296:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144227840 00000100:00100000:3.0:1784938296.490356:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 168 00000100:00100000:3.0:1784938296.490367:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144227840:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938296.490405:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784938296.490553:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144227840:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 187us (6586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938296.490561:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 168 00000100:00100000:1.0:1784938296.490932:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144227840:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938296.932315:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938297.952433:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938297.978237:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938297.978366:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938297.978400:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938297.978420:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938297.978456:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938297.979834:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125252224 00000100:00100000:0.0:1784938297.979853:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125252224 00000100:00100000:0.0:1784938297.979969:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125252480 00000100:00100000:0.0:1784938297.979974:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125252480 00000100:00100000:0.0:1784938297.979999:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125252096 00000100:00100000:0.0:1784938297.980003:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125252096 00000100:00100000:0.0:1784938297.980041:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125252352 00000100:00100000:0.0:1784938297.980046:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125252352 00000100:00100000:0.0:1784938297.980077:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 293 00000100:00100000:0.0:1784938297.980093:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125252224:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938297.980306:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125252224:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 216us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938297.980316:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 293 00000100:00100000:0.0:1784938297.980341:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 294 00000100:00100000:0.0:1784938297.980372:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125252480:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938297.980408:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125252480:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 38us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938297.980415:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 294 00000100:00100000:0.0:1784938297.980428:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 295 00000100:00100000:0.0:1784938297.980435:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125252096:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938297.980623:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125252096:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 188us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938297.980642:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 295 00000100:00100000:0.0:1784938297.980655:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 296 00000100:00100000:0.0:1784938297.980662:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125252352:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938297.980686:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125252352:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938297.980692:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 296 00000100:00080000:1.0:1784938297.981260:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938297.981267:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938297.981382:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125251968 00000100:00100000:2.0:1784938297.981392:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125251968 00000100:00100000:1.0:1784938297.990618:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 384 00000100:00100000:1.0:1784938297.990665:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125251968:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938297.990804:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2393:x1871643125251968:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 160us (12598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938297.990813:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 384 00000100:00100000:1.0:1784938298.017094:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938298.017131:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144227968:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938298.017855:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938298.017929:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144227968 00000100:00100000:1.0:1784938298.017939:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144227968 00000100:00100000:1.0:1784938298.017997:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 128 00000100:00100000:1.0:1784938298.018008:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144227968:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938298.018038:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938298.018334:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144227968:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 326us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938298.018342:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 128 00000100:00080000:1.0:1784938298.018370:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938298.019297:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144227968:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938298.021931:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938298.021967:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144228096:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938298.023401:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938298.024198:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144228224:0@lo:400:kworker.0 00000100:00100000:1.0:1784938298.024317:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938298.024403:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144228352:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938298.024486:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144228224 00000100:00100000:3.0:1784938298.024497:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144228224 00000100:00100000:3.0:1784938298.024565:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1784938298.024577:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144228224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938298.024702:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938298.024749:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144228480:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938298.024855:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938298.024878:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144228480 00000100:00100000:1.0:1784938298.024882:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144228480 00000100:00100000:1.0:1784938298.024916:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 169 00000100:00100000:1.0:1784938298.024923:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144228480:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938298.024960:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144228480:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938298.024968:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 169 00000100:00100000:0.0:1784938298.026010:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144228480:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.026073:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144228352 00000100:00100000:0.0:1784938298.026079:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144228352 00000100:00100000:0.0:1784938298.026127:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 297 00000100:00100000:0.0:1784938298.026136:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144228352:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.026198:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144228352:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 62us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938298.026205:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 297 00000100:00100000:0.0:1784938298.026384:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938298.026424:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144228608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938298.026800:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144228224:12345-0@lo:400:kworker.0 Request processed in 2222us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938298.026818:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1784938298.027048:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144228992:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.027103:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938298.027109:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144229120:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.027176:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144229504:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.027257:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144228736:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.027286:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144229248:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.027320:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144228224:0@lo:400:kworker.0 00000100:00100000:0.0:1784938298.027342:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784938298.027348:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144228864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.027383:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144229376:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938298.028906:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938298.029135:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144228608 00000100:00100000:0.0:1784938298.029147:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144228608 00000100:00100000:0.0:1784938298.029237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 298 00000100:00100000:0.0:1784938298.029248:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144228608:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938298.034910:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938298.034959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938298.034983:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938298.035010:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938298.035041:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938298.035075:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938298.035113:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144228992 00000100:00100000:3.0:1784938298.035121:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144228992 00000100:00100000:3.0:1784938298.035981:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144229504 00000100:00100000:3.0:1784938298.035988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144229504 00000100:00100000:3.0:1784938298.036007:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144229376 00000100:00100000:3.0:1784938298.036010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144229376 00000100:00100000:3.0:1784938298.036028:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 299 00000100:00100000:3.0:1784938298.036038:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144228992:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938298.036121:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144228992:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 84us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938298.036311:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144228096 00000100:00100000:2.0:1784938298.036326:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144228096 00000100:00100000:2.0:1784938298.036432:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 129 00000100:00100000:2.0:1784938298.036443:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144228096:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938298.036474:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938298.036536:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144228096:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 94us (13148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938298.036543:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 129 00000100:00100000:2.0:1784938298.036607:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144229120 00000100:00100000:2.0:1784938298.036612:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144229120 00000100:00100000:2.0:1784938298.036663:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144229248 00000100:00100000:2.0:1784938298.036668:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144229248 00000100:00100000:2.0:1784938298.036694:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 114 00000100:00100000:2.0:1784938298.036701:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144229120:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938298.036732:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144229120:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938298.036739:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 114 00000100:00100000:3.0:1784938298.036887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 299 00000100:00100000:3.0:1784938298.036923:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 300 00000100:00100000:3.0:1784938298.036935:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144229504:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938298.036983:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144229504:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 53us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938298.036990:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 300 00000100:00100000:3.0:1784938298.037003:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 301 00000100:00100000:3.0:1784938298.037010:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144229376:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938298.037055:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144229376:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 46us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938298.037080:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 301 00000100:00080000:3.0:1784938298.037110:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938298.037115:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938298.037118:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938298.037120:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938298.037444:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 115 00000100:00100000:2.0:1784938298.037454:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144229248:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938298.037497:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144229248:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 45us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938298.037503:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 115 00000100:00100000:2.0:1784938298.037571:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144228736 00000100:00100000:2.0:1784938298.037578:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144228736 00000100:00100000:2.0:1784938298.037615:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 170 00000100:00100000:2.0:1784938298.037622:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144228736:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938298.037670:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144228736:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 48us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938298.037676:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 170 00000100:00100000:2.0:1784938298.037741:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144228352:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.042939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144228608:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 13672us (14029us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938298.042959:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 298 00000100:00100000:1.0:1784938298.043962:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938298.044083:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144228864 00000100:00100000:3.0:1784938298.044104:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144228864 00000100:00100000:3.0:1784938298.044317:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 302 00000100:00100000:3.0:1784938298.044328:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144228864:12345-192.168.203.126@tcp:400:kworker.0 00000100:00080000:0.0:1784938298.044759:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938298.069125:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144228864:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24782us (25157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938298.069142:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 302 00010000:00080000:3.0:1784938298.079498:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb64000 x1871643144229504/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938298.079521:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144229504:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938298.079541:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd730700 x1871643144229120/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938298.079550:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144229120:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938298.079563:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd731880 x1871643144228992/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938298.079571:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144228992:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938298.079587:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144228608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938298.079654:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144228096:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938298.086396:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144229376:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938298.086426:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144228736:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938298.086446:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd732d80 x1871643144229248/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938298.086460:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144229248:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938298.086513:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144228864:192.168.203.126@tcp:400:kworker.0 00010000:00010000:1.0:1784938298.975546:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938299.039494:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144229632:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938299.039597:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144229760:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938299.039916:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938299.039983:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938299.041192:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144229632 00000100:00100000:2.0:1784938299.041211:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144229632 00000100:00100000:2.0:1784938299.041288:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144229760 00000100:00100000:2.0:1784938299.041292:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144229760 00000100:00100000:2.0:1784938299.041313:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 130 00000100:00100000:2.0:1784938299.041324:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144229632:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938299.041366:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938299.041469:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144229632:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 147us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938299.041478:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 130 00000100:00100000:2.0:1784938299.041502:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 131 00000100:00100000:2.0:1784938299.041516:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144229760:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938299.041527:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938299.041564:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144229760:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 49us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938299.041572:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 131 00010000:00080000:1.0:1784938299.041806:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb67100 x1871643144229760/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938299.041832:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144229760:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00080000:0.0:1784938299.047976:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffbfd880 x1871643144229632/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938299.048019:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144229632:192.168.203.126@tcp:13:osp-pre-0-1.0 00000001:02000400:3.0:1784938299.157388:0:14058:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:11:37 (1784938297) 00010000:00010000:0.0:1784938300.000779:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938300.063789:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938300.063829:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144229888:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938300.064891:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938300.065068:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144229888 00000100:00100000:1.0:1784938300.065079:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144229888 00000100:00100000:1.0:1784938300.065155:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 171 00000100:00100000:1.0:1784938300.065167:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144229888:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:1.0:1784938300.065263:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784938300.065334:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144229888:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 169us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938300.065343:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 171 00000100:00100000:2.0:1784938300.065848:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144229888:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:3.0:1784938301.023525:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938301.141037:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938301.141174:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125252608 00000100:00100000:3.0:1784938301.141187:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125252608 00000100:00100000:3.0:1784938301.141429:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1784938301.141456:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:11081:x1871643125252608:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938301.141486:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938301.142932:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee57d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28647 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938301.143154:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee584 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938301.143169:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938301.143182:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938301.143395:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784938301.143400:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938301.143436:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938301.143465:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee57d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28647 expref: 7 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938301.143508:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28647 expref: 6 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938301.143517:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cef382100) 00010000:00010000:3.0:1784938301.143521:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938301.143524:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cd9247600, rc 0) 00000100:00100000:3.0:1784938301.143771:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:11081:x1871643125252608:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 2330us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938301.143781:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00080000:0.0:1784938301.146031:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938301.151863:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938301.154540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125252736 00000100:00100000:0.0:1784938301.154562:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125252736 00000100:00100000:0.0:1784938301.154669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1784938301.154684:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:11083:x1871643125252736:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938301.154713:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938301.154742:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee58b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2864e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.154829:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.154848:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.154862:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.154879:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.154887:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.154894:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.154974:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee5a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155004:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155012:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938301.155067:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784938301.155071:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938301.155100:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155113:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155120:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155127:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155135:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938301.155140:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155148:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155163:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cef382100) 00010000:00010000:0.0:1784938301.155167:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938301.155173:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155192:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155259:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155266:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155283:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155290:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938301.155294:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155301:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155311:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff910cfd58b600) 00010000:00010000:0.0:1784938301.155315:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938301.155318:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155324:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee599 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155367:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee58b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2864e expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155382:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2864e expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938301.155398:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910cfd58b700) 00010000:00010000:0.0:1784938301.155401:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938301.155403:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77000, rc 0) 00000100:00100000:0.0:1784938301.155491:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:11083:x1871643125252736:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 810us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938301.155499:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:1.0:1784938301.165497:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938301.165580:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125252864 00000100:00100000:3.0:1784938301.165590:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125252864 00000100:00100000:3.0:1784938301.165657:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1784938301.165668:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:11083:x1871643125252864:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1784938301.166009:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:11083:x1871643125252864:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 Request processed in 340us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938301.166018:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1784938301.169902:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938301.170017:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125253120 00000100:00100000:0.0:1784938301.170034:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125253120 00000100:00100000:0.0:1784938301.170177:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:0.0:1784938301.170189:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:11083:x1871643125253120:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938301.170263:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938301.170301:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee5a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28655 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.170896:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.170918:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.170930:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.170995:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171016:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171023:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171149:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0400/0x26783cd1c59ee5bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171157:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0400/0x26783cd1c59ee5bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171164:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0400/0x26783cd1c59ee5bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938301.171176:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1784938301.171300:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171307:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171314:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171319:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938301.171323:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171330:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171352:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910cfd58b700) 00010000:00010000:1.0:1784938301.171355:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938301.171360:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171368:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee5ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171384:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171390:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171395:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171400:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938301.171402:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171407:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171414:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff910bc66c0e00) 00010000:00010000:1.0:1784938301.171416:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938301.171419:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171425:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee5b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.171988:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee5a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28655 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.172010:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0400/0x26783cd1c59ee5bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28655 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938301.172017:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:1.0:1784938301.172019:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938301.172021:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d0400, rc 0) 00000100:00100000:1.0:1784938301.172097:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:11083:x1871643125253120:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1908us (2203us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1784938301.172104:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1784938301.184504:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938301.184642:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125253248 00000100:00100000:3.0:1784938301.184652:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125253248 00000100:00100000:3.0:1784938301.184918:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:3.0:1784938301.184930:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:11083:x1871643125253248:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784938301.185110:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:11083:x1871643125253248:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 183us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938301.185119:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:0.0:1784938301.198901:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938301.199001:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125253376 00000100:00100000:3.0:1784938301.199010:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125253376 00000100:00100000:3.0:1784938301.199119:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:3.0:1784938301.199129:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:11083:x1871643125253376:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1784938301.200077:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1784938301.201584:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2412us 00000100:00100000:0.0:1784938301.217941:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:11083:x1871643125253376:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 18803us (19040us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938301.217954:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:0.0:1784938301.600770:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144230016:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938301.601028:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938301.601056:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144230016 00000100:00100000:0.0:1784938301.601062:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144230016 00000100:00100000:0.0:1784938301.601110:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 172 00000100:00100000:0.0:1784938301.601118:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144230016:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938301.601151:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938301.601190:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144230016:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938301.601199:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 172 00000100:00100000:0.0:1784938301.601352:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144230016:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:1.0:1784938302.054063:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784938302.176595:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1784938302.181383:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784938303.073243:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938303.098573:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938303.098633:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938303.098665:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938303.098672:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125253504 00000100:00100000:2.0:1784938303.098685:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125253504 00000100:00100000:0.0:1784938303.098689:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938303.098737:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938303.098749:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 386 00000100:00100000:2.0:1784938303.098760:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125253504:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.098760:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125253760 00000100:00100000:0.0:1784938303.098764:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125253760 00000100:00100000:0.0:1784938303.098809:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125254016 00000100:00100000:0.0:1784938303.098812:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125254016 00000100:00100000:0.0:1784938303.098827:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125253632 00000100:00100000:0.0:1784938303.098829:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125253632 00000100:00100000:0.0:1784938303.098843:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125253888 00000100:00100000:0.0:1784938303.098845:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125253888 00000100:00100000:0.0:1784938303.098861:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 303 00000100:00100000:1.0:1784938303.098866:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 304 00000100:00100000:0.0:1784938303.098867:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125253760:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.098875:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125254016:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.098955:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125253760:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938303.098964:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 303 00000100:00100000:0.0:1784938303.098987:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 305 00000100:00100000:0.0:1784938303.098992:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2395:x1871643125253632:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.099757:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125254016:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 872us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.099777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 304 00000100:00100000:1.0:1784938303.099807:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 306 00000100:00100000:1.0:1784938303.099818:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125253888:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.099855:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125253888:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 41us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.099862:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 306 00000100:00100000:2.0:1784938303.100023:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125253504:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1263us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938303.100033:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 386 00000100:00080000:1.0:1784938303.103759:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938303.103845:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938303.108549:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2395:x1871643125253632:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 9535us (9836us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938303.108569:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 305 00000100:00100000:0.0:1784938303.136971:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144230144:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938303.137110:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144230656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.137143:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144231168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.137167:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144231680:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.137197:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784938303.137205:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144230528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.137252:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144231040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.137270:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144230272:0@lo:400:kworker.0 00000100:00100000:0.0:1784938303.137294:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144231552:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.137334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938303.137339:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144230400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.137368:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144230912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.137376:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144230784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.137388:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144231424:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.137395:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144231296:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.137412:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144231808:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.137447:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144230272 00000100:00100000:1.0:1784938303.137456:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144230272 00000100:00100000:1.0:1784938303.137513:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1784938303.137524:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144230272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938303.137590:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ccc754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144230272:12345-0@lo:400:kworker.0 Request processed in 67us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.137611:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1784938303.137679:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144230272:0@lo:400:kworker.0 00000100:00100000:0.0:1784938303.137693:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938303.137710:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144230656 00000100:00100000:1.0:1784938303.137714:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144230656 00000100:00100000:1.0:1784938303.137746:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 307 00000100:00100000:0.0:1784938303.137748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938303.137752:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144230656:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.137782:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144230656:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.137789:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 307 00000100:00100000:0.0:1784938303.137991:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.138069:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.138090:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.138110:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.138165:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.138188:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.138205:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.138990:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.139024:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.139050:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.139086:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938303.139121:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144230144 00000100:00100000:0.0:1784938303.139128:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144230144 00000100:00100000:1.0:1784938303.139297:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144231680 00000100:00100000:1.0:1784938303.139302:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144231680 00000100:00100000:1.0:1784938303.139347:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144231168 00000100:00100000:1.0:1784938303.139351:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144231168 00000100:00100000:0.0:1784938303.139612:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 132 00000100:00100000:0.0:1784938303.139624:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1871643144230144:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938303.139665:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938303.139736:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1871643144230144:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 115us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938303.139744:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 132 00000100:00100000:1.0:1784938303.139890:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144231296 00000100:00100000:1.0:1784938303.139895:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144231296 00000100:00100000:1.0:1784938303.139910:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144231808 00000100:00100000:1.0:1784938303.139912:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144231808 00000100:00100000:1.0:1784938303.139925:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 116 00000100:00100000:1.0:1784938303.139932:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144231680:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.139963:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144231680:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 31us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.139969:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 116 00000100:00100000:1.0:1784938303.139983:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 117 00000100:00100000:1.0:1784938303.139989:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144231168:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.140013:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144231168:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.140018:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 117 00000100:00100000:1.0:1784938303.140028:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 118 00000100:00100000:1.0:1784938303.140033:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144231296:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.140053:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144231296:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.140059:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 118 00000100:00100000:1.0:1784938303.140069:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 119 00000100:00100000:1.0:1784938303.140073:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144231808:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.140093:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144231808:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 19us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.140110:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 119 00000100:00100000:1.0:1784938303.140133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144231040 00000100:00100000:1.0:1784938303.140138:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144231040 00000100:00100000:1.0:1784938303.140161:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144230400 00000100:00100000:1.0:1784938303.140165:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144230400 00000100:00100000:1.0:1784938303.140176:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144231552 00000100:00100000:1.0:1784938303.140179:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144231552 00000100:00100000:1.0:1784938303.140190:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144230912 00000100:00100000:1.0:1784938303.140193:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144230912 00000100:00100000:1.0:1784938303.140204:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144231424 00000100:00100000:1.0:1784938303.140207:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144231424 00000100:00100000:1.0:1784938303.140412:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 308 00000100:00100000:1.0:1784938303.140420:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144231040:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.140462:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144231040:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 43us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.140468:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 308 00000100:00100000:1.0:1784938303.140480:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 309 00000100:00100000:1.0:1784938303.140502:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144230400:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.140526:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144230400:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 41us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.140533:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 309 00000100:00100000:1.0:1784938303.140544:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 310 00000100:00100000:1.0:1784938303.140549:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144231552:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.140582:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144231552:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.140588:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 310 00000100:00100000:1.0:1784938303.140624:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 311 00000100:00100000:1.0:1784938303.140630:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144230912:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.140651:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144230912:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.140657:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 311 00000100:00100000:0.0:1784938303.140890:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144230528 00000100:00100000:0.0:1784938303.140897:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144230528 00000100:00100000:0.0:1784938303.140936:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144230784 00000100:00100000:0.0:1784938303.140939:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144230784 00000100:00100000:0.0:1784938303.140956:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 173 00000100:00100000:0.0:1784938303.140962:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144230528:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.140976:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 312 00000100:00100000:1.0:1784938303.140982:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144231424:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.140990:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144230528:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 29us (2880us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938303.140996:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 173 00000100:00100000:1.0:1784938303.141001:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144231424:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.141007:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 312 00000100:00100000:0.0:1784938303.141011:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 174 00000100:00100000:0.0:1784938303.141016:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144230784:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.141047:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144230784:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 31us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938303.141052:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 174 00000100:00100000:0.0:1784938303.141116:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144231936:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00080000:3.0:1784938303.141853:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938303.141862:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938303.141866:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938303.141869:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938303.142254:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938303.142283:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144231936 00000100:00100000:1.0:1784938303.142291:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144231936 00000100:00100000:1.0:1784938303.142341:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 133 00000100:00100000:1.0:1784938303.142350:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144231936:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938303.142378:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938303.142428:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144231936:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.142435:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 133 00010000:00080000:1.0:1784938303.143432:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7de8000 x1871643144231296/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938303.143438:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144230528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.143448:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144231296:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938303.143455:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7deb480 x1871643144231040/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938303.143465:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144231808:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.143465:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144231040:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938303.143477:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7dea300 x1871643144231552/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938303.143485:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144231552:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.143509:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144230144:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938303.143517:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144230784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.143523:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144230656:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938303.143536:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7de9c00 x1871643144231168/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938303.143543:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144231168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938303.143554:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144231680:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938303.147280:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144230400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938303.147306:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144230912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938303.147321:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144231424:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938303.147375:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144231936:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938303.566518:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938303.566665:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125254144 00000100:00100000:1.0:1784938303.566681:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125254144 00000100:00100000:1.0:1784938303.566777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:1.0:1784938303.566791:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:11125:x1871643125254144:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938303.566825:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938303.566858:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2865c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.566968:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.566988:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567001:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567018:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567025:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567030:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567086:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567093:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567109:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567116:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938303.567120:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567129:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567144:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cef382100) 00010000:00010000:1.0:1784938303.567147:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938303.567152:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567159:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567175:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567181:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567187:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567192:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938303.567194:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567270:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567280:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff910bc66c0500) 00010000:00010000:1.0:1784938303.567283:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938303.567287:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567293:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567332:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2865c expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567343:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cef382100) 00010000:00010000:1.0:1784938303.567346:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938303.567349:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2865c expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.567362:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1200, rc 0) 00000100:00100000:1.0:1784938303.567457:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:11125:x1871643125254144:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 669us (958us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938303.567465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:0.0:1784938303.573806:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938303.573921:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125254400 00000100:00100000:1.0:1784938303.573934:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125254400 00000100:00100000:1.0:1784938303.574022:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:1.0:1784938303.574035:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:11125:x1871643125254400:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:1.0:1784938303.574135:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938303.574172:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee584 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28647 expref: 9 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.574195:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cef382100) 00010000:00010000:1.0:1784938303.574263:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938303.574351:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.574371:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.574384:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.574400:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.574408:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.574415:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.575940:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.575969:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.575981:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938303.576019:0:13805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000654a6354 reply state 0000000098e1dcff transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576033:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576042:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938303.576045:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938303.576050:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784938303.576058:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784938303.576067:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576074:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576081:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576089:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938303.576094:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576103:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576115:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910bc66c0500) 00010000:00010000:1.0:1784938303.576118:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938303.576122:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576140:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee5df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938303.576165:0:13805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000654a6354 reply state 0000000098e1dcff transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576175:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.576182:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff910bc66c0700) 00010000:00010000:1.0:1784938303.576185:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938303.576186:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784938303.578970:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:11125:x1871643125254400:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 4919us (5162us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784938303.578990:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:2.0:1784938303.682647:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938303.683315:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125254528 00000100:00100000:3.0:1784938303.683330:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125254528 00000100:00100000:3.0:1784938303.683425:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1784938303.683439:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:11133:x1871643125254528:12345-192.168.203.26@tcp:101:lctl.0 00010000:00010000:3.0:1784938303.683535:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938303.683569:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee5f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28663 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.683677:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9246c00/0x26783cd1c59ee5fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.683718:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9246c00/0x26783cd1c59ee5fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.683734:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9246c00/0x26783cd1c59ee5fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938303.683802:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784938303.683805:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938303.683856:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9246c00/0x26783cd1c59ee5fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.683885:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee5f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28663 expref: 12 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.683906:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9246c00/0x26783cd1c59ee5fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28663 expref: 11 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.683916:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:3.0:1784938303.683919:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938303.683923:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cd9246c00, rc 0) 00000100:00100000:3.0:1784938303.684009:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:11133:x1871643125254528:12345-192.168.203.26@tcp:101:lctl.0 Request processed in 574us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938303.684017:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:0.0:1784938303.740649:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938303.741163:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125254656 00000100:00100000:1.0:1784938303.741177:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125254656 00000100:00100000:1.0:1784938303.741295:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:1.0:1784938303.741307:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:11139:x1871643125254656:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938303.741338:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938303.741369:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2866a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741458:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741477:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741505:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741520:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741527:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741533:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741643:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee617 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741652:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741660:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938303.741706:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784938303.741711:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938303.741757:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741772:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741780:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741799:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741806:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938303.741811:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741821:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741836:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:1.0:1784938303.741839:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938303.741845:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741850:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741868:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741874:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741879:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741884:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938303.741887:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741902:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741911:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff910bc66c0700) 00010000:00010000:1.0:1784938303.741913:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938303.741915:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741921:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee610 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741950:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2866a expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741967:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2866a expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.741974:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938303.741976:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784938303.741978:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1200, rc 0) 00000100:00100000:1.0:1784938303.742702:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:11139:x1871643125254656:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1392us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.742715:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1784938303.767818:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938303.767963:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125254912 00000100:00100000:1.0:1784938303.767977:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125254912 00000100:00100000:1.0:1784938303.768145:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:1.0:1784938303.768159:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:11139:x1871643125254912:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938303.768616:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938303.768651:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee61e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28671 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.768813:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.768833:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.768848:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.780659:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.780689:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.780705:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938303.781663:0:13805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1784938303.781802:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781815:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781824:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781853:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781860:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781867:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781872:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938303.781876:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781884:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781894:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:0.0:1784938303.781897:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938303.781901:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781906:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee625 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938303.781939:0:13805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de881fa0 reply state 0000000039fe716a transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781951:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.781956:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0c00) 00010000:00010000:0.0:1784938303.781958:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938303.781961:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938303.782000:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee61e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28671 expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.782016:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28671 expref: 14 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.782024:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795400) 00010000:00010000:0.0:1784938303.782026:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938303.782028:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76c00, rc 0) 00000100:00100000:0.0:1784938303.782104:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11139:x1871643125254912:12345-192.168.203.26@tcp:101:bash.0 Request processed in 13949us (14303us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1784938303.782112:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:3.0:1784938303.788836:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938303.790028:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125255040 00000100:00100000:1.0:1784938303.790043:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125255040 00000100:00100000:1.0:1784938303.790104:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:1.0:1784938303.790112:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2391:x1871643125255040:12345-192.168.203.26@tcp:8:bash.0 00010000:00080000:1.0:1784938303.790145:0:8770:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp t0 exp 0000000000000000 cur 371 last 0 00000020:00000080:1.0:1784938303.790178:0:8770:0:(genops.c:1406:class_connect()) connect: client 263deb07-6496-49f7-9596-7a44f1bd8c2b, cookie 0x26783cd1c59ee641 00002000:00100000:1.0:1784938303.790203:0:8770:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 263deb07-6496-49f7-9596-7a44f1bd8c2b/ffff910bc7114000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938303.790287:0:8770:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938303.790369:0:8770:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784938303.790404:0:8770:0:(import.c:65:import_set_state_nolock()) ffff910bc7111000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938303.790481:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2391:x1871643125255040:12345-192.168.203.26@tcp:8:bash.0 Request processed in 367us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.790489:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:2.0:1784938303.797794:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938303.797966:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125255168 00000100:00100000:0.0:1784938303.797979:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125255168 00000100:00100000:0.0:1784938303.798088:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:0.0:1784938303.798100:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:0:x1871643125255168:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1784938303.798128:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938303.798162:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28678 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938303.798258:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938303.798286:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1784938303.798292:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938303.798305:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28678 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.798332:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28678 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.798349:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77800, rc 0) 00000100:00100000:0.0:1784938303.798427:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:0:x1871643125255168:12345-192.168.203.26@tcp:101:bash.0 Request processed in 329us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938303.798443:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00080000:3.0:1784938303.799259:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938303.805713:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938303.805951:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125255296 00000100:00100000:1.0:1784938303.805962:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125255296 00000100:00100000:1.0:1784938303.806026:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:1.0:1784938303.806036:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:11139:x1871643125255296:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938303.806055:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938303.806077:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2867f expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.806109:0:8770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28678 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.806120:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.806124:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.806130:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.806169:0:8770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28678 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.806183:0:8770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28678 expref: 8 pid: 8431 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938303.806260:0:8770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7de8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8770:1871643144232064:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938303.806357:0:8770:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d61a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938303.823115:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938303.823315:0:8770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7de8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8770:1871643144232064:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938303.823366:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938303.823393:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1000, rc 0) 00000100:00100000:3.0:1784938303.823437:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125255424 00000100:00100000:3.0:1784938303.823464:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125255424 00000100:00100000:2.0:1784938303.823502:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:11139:x1871643125255296:12345-192.168.203.26@tcp:101:bash.0 Request processed in 17464us (17799us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938303.823512:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28678 expref: 9 pid: 8431 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938303.823523:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:3.0:1784938303.823736:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1784938303.823749:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125255424:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938303.823765:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938303.823788:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28678 expref: 8 pid: 8431 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.823804:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28678 expref: 8 pid: 8431 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.823830:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063425cb8/0x26783cd1c59ee648 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28678 expref: 8 pid: 8431 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.823851:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938303.823855:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938303.823862:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.823872:0:7921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.823913:0:7921:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938303.823942:0:7921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7921:1871643144232192:192.168.203.26@tcp:105: 00000100:00100000:3.0:1784938303.824022:0:7921:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3f9300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938303.826740:0:7921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7921:1871643144232192:192.168.203.26@tcp:105: 00010000:00010000:3.0:1784938303.826770:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938303.826837:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125255424:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 3090us (3731us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938303.826850:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:1.0:1784938303.841356:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938303.841505:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125255680 00000100:00100000:0.0:1784938303.841515:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125255680 00000100:00100000:0.0:1784938303.841587:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:0.0:1784938303.841609:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11139:x1871643125255680:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:0.0:1784938303.841902:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:11139:x1871643125255680:12345-192.168.203.26@tcp:35:bash.0 Request processed in 294us (555us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784938303.841910:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:1.0:1784938303.989823:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938303.990047:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125255936 00000100:00100000:0.0:1784938303.990062:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125255936 00000100:00100000:0.0:1784938303.990142:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1784938303.990154:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:11149:x1871643125255936:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938303.990207:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938303.990282:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28686 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938303.990423:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784938303.990558:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee656 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28686 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.990576:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:0.0:1784938303.990579:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938303.990585:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28686 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.990620:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76000, rc 0) 00000100:00100000:0.0:1784938303.990806:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:11149:x1871643125255936:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 653us (998us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1784938303.990814:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:2.0:1784938303.995136:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938303.995599:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125256192 00000100:00100000:0.0:1784938303.995612:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125256192 00000100:00100000:0.0:1784938303.995809:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1784938303.995822:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:11149:x1871643125256192:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:0.0:1784938303.996164:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:11149:x1871643125256192:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 344us (1043us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784938303.996173:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:1.0:1784938304.095038:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938304.095163:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125256320 00000100:00100000:0.0:1784938304.095177:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125256320 00000100:00100000:0.0:1784938304.095315:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:0.0:1784938304.095350:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:11155:x1871643125256320:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938304.095385:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938304.095416:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2868d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.095526:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee66b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.095546:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.095563:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938304.095631:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784938304.095635:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938304.095662:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.095705:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2868d expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.095729:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee66b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2868d expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.095739:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:0.0:1784938304.095743:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938304.095747:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76600, rc 0) 00000100:00100000:0.0:1784938304.095838:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11155:x1871643125256320:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 492us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938304.095857:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00010000:00010000:3.0:1784938304.096434:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938304.101650:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938304.101780:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125256576 00000100:00100000:0.0:1784938304.101795:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125256576 00000100:00100000:0.0:1784938304.101881:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:0.0:1784938304.101893:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11155:x1871643125256576:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938304.101924:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938304.101953:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee672 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28694 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.102114:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee679 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.102143:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.102158:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938304.102171:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784938304.102345:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee672 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28694 expref: 22 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.102368:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28694 expref: 21 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.102379:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795400) 00010000:00010000:0.0:1784938304.102382:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938304.102386:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77600, rc 0) 00000100:00100000:0.0:1784938304.102490:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:11155:x1871643125256576:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 599us (855us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1784938304.102499:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:2.0:1784938304.110458:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938304.110593:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938304.110739:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125256704 00000100:00100000:0.0:1784938304.110753:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125256704 00000100:00100000:0.0:1784938304.110846:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:0.0:1784938304.110859:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:2395:x1871643125256704:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938304.110879:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938304.110911:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee679 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28694 expref: 21 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.110937:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795400) 00010000:00010000:0.0:1784938304.110944:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938304.110977:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125256960 00000100:00100000:1.0:1784938304.110984:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125256960 00000100:00100000:0.0:1784938304.111035:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:2395:x1871643125256704:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 177us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938304.111038:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:0.0:1784938304.111053:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:1.0:1784938304.111055:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:11155:x1871643125256960:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938304.111085:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938304.111105:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee687 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2869b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.111296:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee68e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.111313:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee68e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.111326:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee68e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938304.111340:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784938304.111487:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee687 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2869b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.111541:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee68e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2869b expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.111550:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795400) 00010000:00010000:1.0:1784938304.111553:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784938304.111556:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1600, rc 0) 00000100:00100000:1.0:1784938304.111597:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11155:x1871643125256960:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 540us (1001us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1784938304.111604:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:1.0:1784938304.122153:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938304.122284:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125257088 00000100:00100000:0.0:1784938304.122297:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125257088 00000100:00100000:0.0:1784938304.122369:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:0.0:1784938304.122380:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125257088:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:0.0:1784938304.122441:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.122471:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.122481:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784938304.122517:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938304.122522:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.122568:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.122585:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 7 pid: 8770 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938304.122613:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1871643144232320:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938304.122749:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938304.130856:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938304.131008:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1871643144232320:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938304.131054:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938304.134361:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125257216 00000100:00100000:3.0:1784938304.134382:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125257216 00002000:00100000:3.0:1784938304.134458:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff910cffc36680 x1871643125257216/t0(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:535/0 lens 504/0 e 0 to 0 dl 1784938315 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938304.134471:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cffc36680 with x1871643125257216 ext(0->12) 00010000:00010000:3.0:1784938304.134482:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 8 pid: 8770 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.134503:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 8 pid: 8770 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938304.134513:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910cffc36680 00000100:00100000:3.0:1784938304.134562:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:3.0:1784938304.134573:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125257216:12345-192.168.203.26@tcp:4:lfs.0 00000001:00100000:1.0:1784938304.149447:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000100:00100000:3.0:1784938304.152208:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2392:x1871643125257216:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 17619us (21350us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784938304.152277:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00002000:00100000:3.0:1784938304.152297:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff910cffc36680 x1871643125257216/t4294967300(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:535/0 lens 504/448 e 0 to 0 dl 1784938315 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938304.152309:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cffc36680 with x1871643125257216 ext(0->12) 00010000:00010000:3.0:1784938304.152322:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 9 pid: 8770 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.152347:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 9 pid: 8770 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938304.152356:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910cffc36680 00000100:00100000:3.0:1784938304.156353:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938304.159987:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938304.160022:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144232448:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938304.160416:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938304.160454:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144232448 00000100:00100000:1.0:1784938304.160463:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144232448 00000100:00100000:1.0:1784938304.160527:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 134 00000100:00100000:1.0:1784938304.160537:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144232448:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938304.160569:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938304.160783:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144232576:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938304.161926:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938304.161957:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1784938304.161967:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1784938304.162103:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144232576 00000100:00100000:3.0:1784938304.162111:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144232576 00000100:00100000:3.0:1784938304.162288:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 135 00000100:00100000:3.0:1784938304.162298:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144232576:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938304.162323:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938304.162379:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144232576:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 83us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938304.162386:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 135 00000100:00100000:0.0:1784938304.162707:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144232576:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938304.163199:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144232448:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 2659us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938304.163209:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 134 00000100:00100000:1.0:1784938304.165933:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144232448:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938304.166853:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125257344 00000100:00100000:2.0:1784938304.166868:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125257344 00010000:00010000:2.0:1784938304.166950:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 9 pid: 8770 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938304.167005:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1784938304.167017:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2394:x1871643125257344:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938304.167035:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784938304.167060:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784938304.167064:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1784938303 00002000:00010000:2.0:1784938304.167067:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1784938303 00002000:00010000:2.0:1784938304.167069:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1784938303 00002000:00010000:2.0:1784938304.167072:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938304.167079:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 9 pid: 8770 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.167095:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 9 pid: 8770 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.167123:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59ee64f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2867f expref: 9 pid: 8770 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.167148:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938304.167170:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938304.167178:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.167189:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.168076:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938304.168174:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2394:x1871643125257344:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1152us (11829us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938304.168185:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00010000:00010000:0.0:1784938304.173551:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.173837:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.173887:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.173916:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.173925:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.173933:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938304.173938:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.173947:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.173973:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.173980:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006adef790/0x26783cd1c59ee69c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938304.174322:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125257088:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 51934us (52174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938304.174336:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:0.0:1784938304.195353:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938304.195463:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125257600 00000100:00100000:3.0:1784938304.195476:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125257600 00000100:00100000:3.0:1784938304.195573:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:3.0:1784938304.195608:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11155:x1871643125257600:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:3.0:1784938304.195693:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee68e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2869b expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938304.196650:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1784938304.196711:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1784938304.197293:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1784938304.197349:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.197374:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28671 expref: 26 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.197385:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.197434:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28671 expref: 26 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.197455:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28671 expref: 26 pid: 13805 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938304.197474:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1871643144232704:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938304.197625:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938304.211266:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938304.211447:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125257728 00000100:00100000:2.0:1784938304.211461:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125257728 00010000:00010000:2.0:1784938304.211516:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28671 expref: 27 pid: 13805 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938304.211567:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:2.0:1784938304.211579:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:2393:x1871643125257728:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938304.211613:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938304.211621:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28671 expref: 27 pid: 13805 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.211637:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28671 expref: 27 pid: 13805 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.211670:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795400) 00010000:00010000:2.0:1784938304.211676:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.211695:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.211704:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.211729:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938304.211952:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:2393:x1871643125257728:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 375us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938304.211960:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00010000:00010000:3.0:1784938304.213732:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ee633 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28671 expref: 26 pid: 13805 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938304.213778:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1871643144232704:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938304.213835:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.213849:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.213856:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938304.214021:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1784938304.214180:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1784938304.214364:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dd8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144232832:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784938304.214481:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938304.215067:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938304.215155:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144232832 00000100:00100000:0.0:1784938304.215164:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144232832 00000100:00100000:0.0:1784938304.215268:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 175 00000100:00100000:0.0:1784938304.215280:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1871643144232832:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784938304.215394:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1871643144232832:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 Request processed in 117us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938304.215403:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 175 00000100:00100000:1.0:1784938304.215968:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dd8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144232832:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784938304.216201:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1784938304.216373:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7deb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144232960:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784938304.216488:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc98c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938304.223281:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938304.223444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144232960 00000100:00100000:1.0:1784938304.223458:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144232960 00000100:00100000:1.0:1784938304.223543:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 176 00000100:00100000:1.0:1784938304.223555:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1871643144232960:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784938304.223830:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1871643144232960:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 Request processed in 277us (565us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784938304.223839:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 176 00000100:00100000:0.0:1784938304.224729:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7deb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144232960:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784938304.224842:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1784938304.224911:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.224924:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.224933:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.224940:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938304.224945:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.224954:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.224974:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795400) 00010000:00010000:0.0:1784938304.224991:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784938304.224997:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.225005:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938304.225174:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784938304.225307:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1784938304.225321:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372257106048ns, next at 373257101774ns, rc = 0 00000001:00080000:0.0:1784938304.225575:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1784938304.225634:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795400) 00010000:00010000:0.0:1784938304.225638:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784938304.225645:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee68e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2869b expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938304.225800:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:11155:x1871643125257600:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 30194us (30463us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1784938304.225810:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000020:00080000:0.0:1784938304.225818:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784938304.229900:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938304.230012:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125257856 00000100:00100000:0.0:1784938304.230027:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125257856 00000100:00100000:0.0:1784938304.230105:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1784938304.230118:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:11155:x1871643125257856:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938304.230158:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938304.230188:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee6aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.230299:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee6aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286a2 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.230317:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee6aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286a2 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.230368:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938304.230371:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938304.230376:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76000, rc 0) 00000100:00100000:0.0:1784938304.230443:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:11155:x1871643125257856:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 328us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938304.230450:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:3.0:1784938304.235289:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938304.237026:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125258112 00000100:00100000:1.0:1784938304.237046:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125258112 00000100:00100000:1.0:1784938304.237132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:1.0:1784938304.237145:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:11155:x1871643125258112:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938304.237793:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+31:11155:x1871643125258112:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 644us (2513us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1784938304.237805:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:2.0:1784938304.342360:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938304.346140:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125258368 00000100:00100000:0.0:1784938304.346168:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125258368 00000100:00100000:0.0:1784938304.346339:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:0.0:1784938304.346354:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+31:11165:x1871643125258368:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938304.346396:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938304.346431:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee6b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286a9 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938304.346599:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784938304.346745:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee6b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286a9 expref: 33 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.346763:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:0.0:1784938304.346767:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938304.346773:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee6b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286a9 expref: 33 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.346802:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77800, rc 0) 00000100:00100000:0.0:1784938304.346900:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:11165:x1871643125258368:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 549us (4554us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1784938304.346932:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:2.0:1784938304.350036:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938304.350380:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125258496 00000100:00100000:3.0:1784938304.350396:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125258496 00000100:00100000:3.0:1784938304.350479:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:3.0:1784938304.350717:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:11165:x1871643125258496:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:3.0:1784938304.350828:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.350851:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.350866:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.350880:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.350910:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.350917:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351017:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351025:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351031:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938304.351099:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351114:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351120:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351128:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351134:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938304.351140:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351149:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351172:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:3.0:1784938304.351175:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938304.351182:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351188:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247e00/0x26783cd1c59ee6bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351205:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351211:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351275:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351281:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938304.351284:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351291:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351299:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0c00) 00010000:00010000:3.0:1784938304.351302:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938304.351306:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351312:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9247600/0x26783cd1c59ee6c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351335:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351342:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351348:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351353:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc0030000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938304.351357:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351363:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351371:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:3.0:1784938304.351376:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938304.351379:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.351385:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc0030000/0x26783cd1c59ee6cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938304.351830:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:11165:x1871643125258496:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 1337us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938304.351842:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:1.0:1784938304.356846:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938304.357950:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125258752 00000100:00100000:2.0:1784938304.357970:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125258752 00000100:00100000:2.0:1784938304.358055:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:2.0:1784938304.358068:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:11165:x1871643125258752:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1784938304.358445:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:11165:x1871643125258752:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 378us (1615us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1784938304.358454:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1784938304.423576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938304.423686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125259008 00000100:00100000:1.0:1784938304.423700:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125259008 00000100:00100000:1.0:1784938304.423784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:1.0:1784938304.423795:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:11168:x1871643125259008:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938304.423842:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938304.423873:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee6d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424048:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424070:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424085:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424097:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424105:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424111:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424448:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424459:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424466:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938304.424478:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784938304.424622:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424632:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424645:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424652:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938304.424657:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424666:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424679:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938304.424683:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938304.424689:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424696:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ee6db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424713:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424719:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424725:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424730:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938304.424733:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424750:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424758:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0c00) 00010000:00010000:1.0:1784938304.424761:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938304.424764:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424771:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ee6e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424820:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ee6d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b0 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424837:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b0 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.424844:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938304.424846:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938304.424849:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1600, rc 0) 00000100:00100000:1.0:1784938304.424946:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:11168:x1871643125259008:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1152us (1383us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1784938304.424955:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1784938304.428549:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938304.428774:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125259136 00000100:00100000:1.0:1784938304.428789:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125259136 00000100:00100000:1.0:1784938304.428928:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:1.0:1784938304.428941:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:11168:x1871643125259136:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1784938304.429348:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.429373:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.429387:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.429437:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.429445:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.429452:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.429459:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938304.429465:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.429473:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.429775:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938304.429780:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938304.429787:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.429795:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ee6f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938304.430045:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:11168:x1871643125259136:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 1095us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938304.430055:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:1.0:1784938304.441783:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938304.442037:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125259392 00000100:00100000:2.0:1784938304.442051:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125259392 00000100:00100000:2.0:1784938304.442164:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:2.0:1784938304.442205:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:11168:x1871643125259392:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1784938304.442595:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+36:11168:x1871643125259392:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 392us (815us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1784938304.442605:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:1.0:1784938304.743723:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938304.743867:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125259648 00000100:00100000:2.0:1784938304.743883:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125259648 00000100:00100000:2.0:1784938304.744084:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1784938304.744117:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+36:11199:x1871643125259648:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1784938304.744154:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938304.744185:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee6fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286b7 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.744379:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59ee705 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.744398:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59ee705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.744412:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59ee705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938304.744425:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784938304.744581:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee6fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b7 expref: 39 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.744615:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59ee705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b7 expref: 38 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.744651:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938304.744655:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938304.744660:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1a00, rc 0) 00000100:00100000:2.0:1784938304.744755:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:11199:x1871643125259648:12345-192.168.203.26@tcp:101:cat.0 Request processed in 660us (1050us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1784938304.750425:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938304.751276:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:3.0:1784938304.752493:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125260032 00000100:00100000:3.0:1784938304.752512:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125260032 00000100:00100000:3.0:1784938304.752643:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:3.0:1784938304.752656:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:2394:x1871643125260032:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938304.752679:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938304.753040:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59ee705 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b7 expref: 38 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938304.753069:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:3.0:1784938304.753075:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938304.753441:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:2394:x1871643125260032:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 785us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938304.753452:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:2.0:1784938304.766017:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938304.772883:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125259904 00000100:00100000:1.0:1784938304.772906:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125259904 00000100:00100000:1.0:1784938304.773005:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1784938304.773017:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:11199:x1871643125259904:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:1.0:1784938304.774131:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:11199:x1871643125259904:12345-192.168.203.26@tcp:35:cat.0 Request processed in 1104us (8123us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1784938304.774144:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1784938304.871371:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938304.871481:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125260288 00000100:00100000:0.0:1784938304.871494:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125260288 00000100:00100000:0.0:1784938304.871577:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:0.0:1784938304.871600:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:11205:x1871643125260288:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:0.0:1784938304.871642:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938304.871647:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784938304.871682:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ee66b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2868d expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.871716:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:0.0:1784938304.871724:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938304.871743:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee713 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286be expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.871896:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.871914:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b0 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.872440:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.872493:0:13805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b0 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938304.872538:0:13805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b0 expref: 38 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938304.872565:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f72680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144233088:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938304.873169:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1784938304.880176:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938304.880318:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125260416 00000100:00100000:2.0:1784938304.880330:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125260416 00010000:00010000:2.0:1784938304.880403:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b0 expref: 39 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938304.880458:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:2.0:1784938304.880469:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:2392:x1871643125260416:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938304.880503:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938304.880511:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b0 expref: 39 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.880528:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b0 expref: 39 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.880566:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938304.880573:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.880594:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.880622:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.880648:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938304.880734:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:2392:x1871643125260416:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 265us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938304.880741:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00010000:00010000:1.0:1784938304.885939:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59ee6e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286b0 expref: 38 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938304.885977:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f72680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144233088:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938304.886010:0:13805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.886023:0:13805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.886029:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938304.886059:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784938304.886337:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee713 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286be expref: 39 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.886360:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286be expref: 38 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.886370:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938304.886373:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784938304.886377:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77a00, rc 0) 00000100:00100000:1.0:1784938304.886475:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:11205:x1871643125260288:12345-192.168.203.26@tcp:101:dd.0 Request processed in 14877us (15115us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1784938304.886485:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:3.0:1784938304.890353:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938304.890473:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125260544 00000100:00100000:1.0:1784938304.890486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125260544 00000100:00100000:1.0:1784938304.890555:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:1.0:1784938304.890566:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:11205:x1871643125260544:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:1.0:1784938304.890621:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938304.890655:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee728 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.890700:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.890835:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.890851:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.891434:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee728 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286c5 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.891460:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286c5 expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938304.891471:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938304.891474:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784938304.891478:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b800, rc 0) 00000100:00100000:1.0:1784938304.891566:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:11205:x1871643125260544:12345-192.168.203.26@tcp:101:dd.0 Request processed in 1001us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938304.891574:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:3.0:1784938304.895738:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938304.896353:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125260800 00000100:00100000:2.0:1784938304.896368:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125260800 00000100:00100000:2.0:1784938304.896459:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:2.0:1784938304.896471:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:11205:x1871643125260800:12345-192.168.203.26@tcp:36:dd.0 00010000:00010000:2.0:1784938304.896887:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.896910:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.896992:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938304.897053:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1784938304.897082:0:9526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3a92857 reply state 000000005037c025 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.897097:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938304.897106:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938304.897109:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938304.897131:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938304.897458:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+42:11205:x1871643125260800:12345-192.168.203.26@tcp:36:dd.0 Request processed in 985us (1731us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1784938304.897468:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000020:00080000:2.0:1784938304.897477:0:9526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784938305.121119:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938305.183675:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938305.183717:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144233216:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938305.184273:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938305.184360:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144233216 00000100:00100000:2.0:1784938305.184371:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144233216 00000100:00100000:2.0:1784938305.184437:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 177 00000100:00100000:2.0:1784938305.184448:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144233216:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938305.184500:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1784938305.184558:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144233216:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938305.184565:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 177 00000100:00100000:2.0:1784938305.185450:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144233216:192.168.203.126@tcp:41:osp-pre-0-1.0 00000040:00080000:2.0:1784938305.247996:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1784938305.248736:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784938305.339799:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938305.340622:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125260928 00000100:00100000:1.0:1784938305.340641:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125260928 00000100:00100000:1.0:1784938305.340752:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:1.0:1784938305.340766:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+42:11219:x1871643125260928:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:1.0:1784938305.340800:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938305.340829:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee73d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286cc expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.340922:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.340940:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.340990:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.341004:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.341012:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.341019:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.341109:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.341121:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286be expref: 43 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.341130:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.341172:0:13805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286be expref: 43 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.341189:0:13805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286be expref: 43 pid: 13805 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938305.341205:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7deb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144233344:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938305.341411:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7c5e780 going to sleep for 11 seconds 00000100:00080000:3.0:1784938305.342201:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938305.345323:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7deb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144233344:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938305.345367:0:13805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938305.347138:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938305.355158:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125261184 00000100:00100000:2.0:1784938305.355185:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125261184 00000100:00100000:2.0:1784938305.355321:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1784938305.355335:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+44:6164:x1871643125261184:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784938305.360390:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+45:6164:x1871643125261184:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 5042us (13250us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1784938305.360415:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:0.0:1784938305.370256:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938305.370570:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125261312 00000100:00100000:2.0:1784938305.370593:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125261312 00010000:00010000:2.0:1784938305.370657:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286be expref: 45 pid: 13805 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938305.370749:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:2.0:1784938305.370761:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+45:2394:x1871643125261312:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938305.370786:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938305.370795:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286be expref: 45 pid: 13805 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.370812:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286be expref: 45 pid: 13805 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.370842:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee71a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286be expref: 45 pid: 13805 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.370866:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938305.370873:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.370884:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.370893:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.370949:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938305.371030:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+44:2394:x1871643125261312:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 271us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938305.371041:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00010000:00010000:1.0:1784938305.371178:0:13805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371188:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938305.371300:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784938305.371305:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938305.371353:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371369:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371379:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371387:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371393:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371400:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938305.371405:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371414:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371437:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938305.371440:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938305.371445:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371452:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee744 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371466:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371473:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371479:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371485:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215bc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938305.371488:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371495:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371503:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0c00) 00010000:00010000:1.0:1784938305.371505:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938305.371507:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371512:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee74b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371564:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee73d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286cc expref: 44 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371591:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286cc expref: 43 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.371600:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938305.371602:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938305.371605:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b200, rc 0) 00000100:00100000:1.0:1784938305.371641:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+43:11219:x1871643125260928:12345-192.168.203.26@tcp:101:stat.0 Request processed in 30880us (31860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938305.371650:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:0.0:1784938305.454839:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938305.455756:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125261568 00000100:00100000:1.0:1784938305.455774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125261568 00000100:00100000:1.0:1784938305.455881:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:1.0:1784938305.455894:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+43:11225:x1871643125261568:12345-192.168.203.26@tcp:36:truncate.0 00010000:00010000:1.0:1784938305.455994:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938305.456030:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee752 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286cc expref: 43 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.456057:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938305.456064:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938305.456484:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.456502:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.456534:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938305.456601:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1784938305.456625:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ea5963a reply state 00000000c9dd5d1c transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.456639:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.456645:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938305.456648:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938305.456652:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938305.456807:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+45:11225:x1871643125261568:12345-192.168.203.26@tcp:36:truncate.0 Request processed in 914us (1979us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1784938305.456816:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000020:00080000:1.0:1784938305.456823:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784938305.672043:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938305.672195:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125261696 00000100:00100000:2.0:1784938305.672289:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125261696 00000100:00100000:2.0:1784938305.672391:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:2.0:1784938305.672403:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+45:11239:x1871643125261696:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:2.0:1784938305.672438:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938305.672467:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee760 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286d3 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.672552:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.672571:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.672758:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.672777:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.672784:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.672790:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.672893:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.672903:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.672909:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938305.672969:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1784938305.672975:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938305.673001:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673015:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673024:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673030:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673037:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673042:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938305.673048:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673056:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673070:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:2.0:1784938305.673073:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938305.673078:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673084:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee767 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673109:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673115:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673122:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673128:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938305.673131:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673137:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673145:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0c00) 00010000:00010000:2.0:1784938305.673147:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938305.673150:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673157:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee76e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673188:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee760 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286d3 expref: 47 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673202:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286d3 expref: 46 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938305.673512:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938305.673516:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938305.673519:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1c00, rc 0) 00000100:00100000:2.0:1784938305.673668:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+46:11239:x1871643125261696:12345-192.168.203.26@tcp:101:stat.0 Request processed in 1265us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938305.673677:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:0.0:1784938305.786050:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938305.789028:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125261952 00000100:00100000:1.0:1784938305.789051:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125261952 00000100:00100000:1.0:1784938305.789254:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:1.0:1784938305.789269:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+46:11249:x1871643125261952:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938305.789310:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938305.789340:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee77c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286da expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938305.789532:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784938305.789687:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee77c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286da expref: 48 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.789721:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:1.0:1784938305.789725:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938305.789732:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee77c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286da expref: 48 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.789749:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b200, rc 0) 00000100:00100000:1.0:1784938305.790171:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+47:11249:x1871643125261952:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 902us (4132us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1784938305.790181:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:0.0:1784938305.794387:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938305.798281:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125262208 00000100:00100000:2.0:1784938305.798312:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125262208 00000100:00100000:2.0:1784938305.798405:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:2.0:1784938305.798417:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+47:11249:x1871643125262208:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1784938305.798761:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+48:11249:x1871643125262208:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 344us (4388us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1784938305.798769:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1784938305.869923:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938305.870271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125262464 00000100:00100000:1.0:1784938305.870284:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125262464 00000100:00100000:1.0:1784938305.870368:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:1.0:1784938305.870381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+48:11255:x1871643125262464:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938305.870412:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938305.870441:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee78a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.870598:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.870617:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286d3 expref: 49 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.870629:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.870673:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286d3 expref: 49 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.870721:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286d3 expref: 49 pid: 9526 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938305.870738:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7deb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144233472:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938305.870870:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7c5e540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938305.875263:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7deb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144233472:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938305.875305:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938305.877679:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938305.878846:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125262592 00000100:00100000:1.0:1784938305.878866:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125262592 00010000:00010000:1.0:1784938305.878941:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286d3 expref: 50 pid: 9526 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938305.879066:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:1.0:1784938305.879079:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+50:2392:x1871643125262592:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938305.879102:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938305.879110:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286d3 expref: 50 pid: 9526 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.879127:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286d3 expref: 50 pid: 9526 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.879157:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee775 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286d3 expref: 50 pid: 9526 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.879210:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938305.879262:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.879280:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.879290:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.879334:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938305.879414:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+49:2392:x1871643125262592:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 337us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938305.879422:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00010000:00010000:0.0:1784938305.879562:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.879572:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938305.879608:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1784938305.879823:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee78a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e1 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.879844:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e1 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.879852:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938305.879855:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784938305.879868:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215bc00, rc 0) 00000100:00100000:0.0:1784938305.879900:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+49:11255:x1871643125262464:12345-192.168.203.26@tcp:101:bash.0 Request processed in 9523us (9993us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1784938305.879907:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:0.0:1784938305.883100:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938305.883203:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125262848 00000100:00100000:3.0:1784938305.883247:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125262848 00000100:00100000:3.0:1784938305.883328:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:3.0:1784938305.883340:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+49:11255:x1871643125262848:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:3.0:1784938305.883668:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938305.883692:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938305.883790:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938305.883842:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1784938305.883866:0:9526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000258ff1e3 reply state 00000000049ff1fb transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938305.883883:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938305.883892:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:3.0:1784938305.883895:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938305.883900:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938305.884038:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+52:11255:x1871643125262848:12345-192.168.203.26@tcp:36:bash.0 Request processed in 698us (950us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1784938305.884047:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000020:00080000:3.0:1784938305.884053:0:9526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784938305.891056:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938305.891114:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125262976 00000100:00100000:1.0:1784938305.891127:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125262976 00000100:00100000:1.0:1784938305.891242:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:1.0:1784938305.891255:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+52:11255:x1871643125262976:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938305.891297:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938305.891901:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee7a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286e8 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.892038:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.892060:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e1 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.892095:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.892139:0:13805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e1 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.892157:0:13805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e1 expref: 53 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938305.892174:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144233600:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938305.893457:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7c5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938305.896144:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938305.896542:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144233600:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938305.896571:0:13805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938305.896866:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125263104 00000100:00100000:0.0:1784938305.896882:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125263104 00010000:00010000:0.0:1784938305.897136:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e1 expref: 54 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938305.897393:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:0.0:1784938305.897408:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:2392:x1871643125263104:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938305.897431:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938305.897441:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e1 expref: 54 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.897457:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e1 expref: 54 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.897488:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee791 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e1 expref: 54 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.897513:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938305.897519:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.897533:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.897590:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.897627:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938305.897722:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+53:2392:x1871643125263104:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 317us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938305.897730:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00010000:00010000:1.0:1784938305.897807:0:13805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.897826:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938305.897898:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784938305.897903:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938305.897931:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.897972:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee7a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e8 expref: 53 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.898004:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e8 expref: 52 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938305.898014:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938305.898017:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938305.898020:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215ba00, rc 0) 00000100:00100000:1.0:1784938305.898068:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+52:11255:x1871643125262976:12345-192.168.203.26@tcp:101:bash.0 Request processed in 6816us (7028us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938305.898075:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:3.0:1784938305.900983:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938305.901980:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125263360 00000100:00100000:2.0:1784938305.901990:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125263360 00000100:00100000:2.0:1784938305.902113:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:2.0:1784938305.902126:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+52:11255:x1871643125263360:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:2.0:1784938305.902417:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+53:11255:x1871643125263360:12345-192.168.203.26@tcp:35:bash.0 Request processed in 294us (1442us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1784938305.902425:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:3.0:1784938305.991488:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938305.992054:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125263616 00000100:00100000:0.0:1784938305.992064:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125263616 00000100:00100000:0.0:1784938305.992252:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:0.0:1784938305.992263:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+53:11265:x1871643125263616:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938305.992286:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938305.992307:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee7b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286ef expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938305.992417:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784938305.992501:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee7b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286ef expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.992515:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:0.0:1784938305.992518:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938305.992523:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee7b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286ef expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.992537:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77e00, rc 0) 00000100:00100000:0.0:1784938305.992599:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:11265:x1871643125263616:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 338us (1122us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1784938305.992615:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:3.0:1784938305.999124:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938305.999193:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125263744 00000100:00100000:0.0:1784938305.999203:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125263744 00000100:00100000:0.0:1784938305.999299:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:0.0:1784938305.999308:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:11265:x1871643125263744:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:0.0:1784938305.999385:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999402:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999416:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999427:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999434:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999440:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999512:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999521:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999528:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938305.999602:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999615:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999621:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999628:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999633:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938305.999636:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999643:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999656:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:0.0:1784938305.999659:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938305.999664:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999670:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee7c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999684:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999690:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999703:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999708:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938305.999712:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999718:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999727:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0c00) 00010000:00010000:0.0:1784938305.999729:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938305.999731:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999736:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999747:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999753:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999759:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999765:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938305.999768:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999783:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999791:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938305.999793:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938305.999796:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938305.999801:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee7d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938305.999874:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:11265:x1871643125263744:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 565us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938305.999881:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:1.0:1784938306.007398:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938306.007502:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125264000 00000100:00100000:2.0:1784938306.007512:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125264000 00000100:00100000:2.0:1784938306.007585:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1784938306.007596:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:11265:x1871643125264000:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1784938306.007855:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+55:11265:x1871643125264000:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 259us (465us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1784938306.007862:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:3.0:1784938306.096133:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938306.097878:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125264256 00000100:00100000:1.0:1784938306.097896:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125264256 00000100:00100000:2.0:1784938306.098094:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:2.0:1784938306.098106:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+55:11268:x1871643125264256:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938306.098139:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938306.098166:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee7d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286f6 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098278:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098294:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098308:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098318:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098325:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098331:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098534:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee7ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098815:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098823:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee7ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938306.098835:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784938306.098949:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098957:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098965:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098972:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938306.098978:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.098987:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099001:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:2.0:1784938306.099004:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938306.099009:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099016:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee7de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099033:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099047:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099052:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099057:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938306.099060:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099066:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099074:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0c00) 00010000:00010000:2.0:1784938306.099076:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938306.099079:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099085:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee7e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099141:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee7d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286f6 expref: 58 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099155:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee7ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286f6 expref: 57 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.099163:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938306.099165:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938306.099179:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1000, rc 0) 00000100:00100000:2.0:1784938306.099935:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+57:11268:x1871643125264256:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1820us (3811us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1784938306.099948:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:3.0:1784938306.107980:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938306.108039:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938306.108138:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125264512 00000100:00100000:1.0:1784938306.108151:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125264512 00000100:00100000:1.0:1784938306.108244:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:1.0:1784938306.108256:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+57:2393:x1871643125264512:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938306.108276:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938306.108305:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee7ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286f6 expref: 57 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938306.108329:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938306.108335:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938306.108505:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+56:2393:x1871643125264512:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 251us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938306.108513:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1784938306.110129:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125264384 00000100:00100000:0.0:1784938306.110148:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125264384 00000100:00100000:0.0:1784938306.110461:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:0.0:1784938306.110473:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+56:11268:x1871643125264384:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1784938306.110594:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.110615:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.110629:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.110688:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.110724:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.110732:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.110740:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938306.110745:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.110754:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.110770:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938306.110774:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938306.110780:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.110786:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee7fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938306.110890:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+56:11268:x1871643125264384:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 420us (2922us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938306.110899:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:3.0:1784938306.114273:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938306.114413:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125264768 00000100:00100000:1.0:1784938306.114424:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125264768 00000100:00100000:1.0:1784938306.114495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1784938306.114507:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+56:11268:x1871643125264768:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938306.114867:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+57:11268:x1871643125264768:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 361us (652us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1784938306.114876:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00010000:00010000:3.0:1784938306.143627:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938306.327568:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938306.327809:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125265024 00000100:00100000:2.0:1784938306.327825:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125265024 00000100:00100000:2.0:1784938306.327910:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:2.0:1784938306.327922:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+57:11286:x1871643125265024:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1784938306.327957:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938306.327988:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee801 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a286fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.328129:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee808 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.328149:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee808 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.328163:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee808 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938306.328176:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784938306.328413:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee801 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286fd expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.328435:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee808 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286fd expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.328446:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938306.328458:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784938306.328463:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0c00, rc 0) 00000100:00100000:2.0:1784938306.328539:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+59:11286:x1871643125265024:12345-192.168.203.26@tcp:101:cat.0 Request processed in 620us (996us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1784938306.331153:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 74 00000001:00080000:2.0:1784938306.337161:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:2.0:1784938306.337264:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1784938306.337297:0:6492:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910bc7d61a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1784938306.337303:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cd215f000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910bc7d613c0 00000020:00080000:2.0:1784938306.337306:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cd215ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910cc5f56000 00000100:00100000:2.0:1784938306.338262:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144233728:192.168.203.126@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938306.338530:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338544:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338562:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338599:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938306.338605:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338614:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338634:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff910bc66c0700) 00010000:00010000:0.0:1784938306.338638:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938306.338645:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338652:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ee5e6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338681:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338688:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338695:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338710:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938306.338713:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338719:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338740:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:0.0:1784938306.338743:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938306.338746:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338752:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ee5ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338769:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338776:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338783:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338789:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938306.338792:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338799:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338806:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0c00) 00010000:00010000:0.0:1784938306.338809:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938306.338812:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338818:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59ee62c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338848:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338855:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338861:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338867:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938306.338870:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338877:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338886:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938306.338889:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938306.338892:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338899:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee736 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338910:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338917:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338924:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338935:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938306.338938:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338945:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338954:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938306.338957:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938306.338960:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338966:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee759 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338980:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338987:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338993:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.338999:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938306.339002:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.339008:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.339026:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938306.339028:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938306.339031:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.339037:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ee79f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784938306.339250:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1784938306.339485:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1784938306.340038:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938306.340076:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144233728 00000100:00100000:3.0:1784938306.340087:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144233728 00000100:00100000:3.0:1784938306.340170:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:3.0:1784938306.340183:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1871643144233728:12345-192.168.203.126@tcp:6:osp-syn-0-0.0 00002000:00080000:3.0:1784938306.340257:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1784938306.340300:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a63ff3f, atime: 0x6a63ff3f, ctime: 0x6a63ff3f, blocks: 0x8 00010000:00010000:3.0:1784938306.340309:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.340330:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1784938306.340335:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938306.340344:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.340363:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.340374:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.340383:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.340403:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938306.340604:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1871643144233728:12345-192.168.203.126@tcp:6:osp-syn-0-0.0 Request processed in 423us (570us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784938306.340612:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00080000:3.0:1784938306.340642:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784938306.340658:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938306.340672:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.340680:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938306.340685:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.340695:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938306.341309:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910cc875ea00/2, rc 0, transno 4294967302 00000100:00100000:2.0:1784938306.341322:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144233728:192.168.203.126@tcp:6:osp-syn-0-0.0 00010000:00010000:3.0:1784938306.341571:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.341897:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006169017c/0x26783cd1c59ee816 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.341931:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938306.341934:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938306.341936:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938306.385877:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938306.386295:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125265152 00000100:00100000:2.0:1784938306.386309:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125265152 00000100:00100000:2.0:1784938306.386386:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:2.0:1784938306.386398:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11287:x1871643125265152:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938306.386430:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938306.386457:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee81d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28704 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.386542:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee824 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.386569:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.386617:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938306.386677:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1784938306.386682:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938306.386717:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.386751:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee81d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28704 expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.386774:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee824 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28704 expref: 14 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.386786:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:2.0:1784938306.386789:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938306.386793:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0e00, rc 0) 00000100:00100000:2.0:1784938306.386879:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11287:x1871643125265152:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 483us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938306.386886:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:1.0:1784938306.402488:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938306.403073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125265536 00000100:00100000:2.0:1784938306.403089:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125265536 00000100:00100000:2.0:1784938306.403173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:2.0:1784938306.403187:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11287:x1871643125265536:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1784938306.403899:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11287:x1871643125265536:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 710us (1421us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1784938306.403909:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1784938306.410449:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938306.410798:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125265664 00000100:00100000:3.0:1784938306.410813:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125265664 00000100:00100000:3.0:1784938306.410952:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1784938306.410964:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7debb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11287:x1871643125265664:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:3.0:1784938306.410986:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784938306.411018:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee7ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286e8 expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.411069:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee808 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286fd expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.411083:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ee6aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286a2 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938306.411096:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:3.0:1784938306.411102:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938306.411270:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7debb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:11287:x1871643125265664:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 307us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938306.411279:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:1.0:1784938306.417993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938306.418092:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125265792 00000100:00100000:0.0:1784938306.418106:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125265792 00000100:00100000:0.0:1784938306.418188:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:0.0:1784938306.418201:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:11287:x1871643125265792:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:0.0:1784938306.418419:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.418443:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938306.418457:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784938306.419168:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938306.419402:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1784938306.419521:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1784938306.419920:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:11287:x1871643125265792:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 1714us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938306.419933:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:1.0:1784938306.461585:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938306.461732:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125265920 00000100:00100000:2.0:1784938306.461745:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125265920 00000100:00100000:2.0:1784938306.461831:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:2.0:1784938306.461842:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:11289:x1871643125265920:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938306.461872:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938306.461900:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee832 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2870b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.461990:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462008:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462023:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462042:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462051:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462058:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462155:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462166:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462197:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938306.462298:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784938306.462311:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938306.462336:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462351:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462359:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462367:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462375:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462382:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938306.462387:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462397:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462411:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:2.0:1784938306.462414:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938306.462420:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462437:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59ee839 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462455:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462462:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462469:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462475:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938306.462478:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462485:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462494:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910cfcf9cc00) 00010000:00010000:2.0:1784938306.462497:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938306.462500:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462507:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ee840 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462546:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ee832 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2870b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462560:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2870b expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938306.462766:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938306.462769:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938306.462773:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0c00, rc 0) 00000100:00100000:2.0:1784938306.462861:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11289:x1871643125265920:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1019us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938306.462870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:0.0:1784938306.719413:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938306.719444:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc8758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144233856:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938306.719707:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938306.719733:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144233856 00000100:00100000:0.0:1784938306.719740:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144233856 00000100:00100000:0.0:1784938306.719784:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 178 00000100:00100000:0.0:1784938306.719793:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144233856:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938306.719838:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938306.719882:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144233856:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938306.719889:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 178 00000100:00100000:0.0:1784938306.720022:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc8758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144233856:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:1.0:1784938307.170670:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938307.279458:0:14207:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938307.279468:0:14207:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938307.279971:0:14207:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1784938307.279982:0:14207:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1784938307.296366:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938307.296375:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938307.296410:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784938307.296420:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784938307.296565:0:13794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144233984:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784938307.296664:0:13794:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938307.321732:0:13794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144233984:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784938307.325059:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.325183:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125266048 00000100:00100000:3.0:1784938307.325202:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125266048 00000100:00080000:1.0:1784938307.325254:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938307.325289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:3.0:1784938307.325304:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11300:x1871643125266048:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784938307.325334:0:6512:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784938307.325467:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11300:x1871643125266048:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 166us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938307.325475:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:0.0:1784938307.330459:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938307.331172:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125266176 00000100:00100000:1.0:1784938307.331189:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125266176 00000100:00100000:1.0:1784938307.332164:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:1.0:1784938307.332185:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11300:x1871643125266176:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784938307.332336:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332374:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332391:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332555:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332590:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332604:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332648:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332659:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332666:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938307.332885:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784938307.332890:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938307.332904:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332918:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332941:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.332948:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333024:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938307.333029:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333038:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333051:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:1.0:1784938307.333054:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938307.333058:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333064:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee84e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333077:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333083:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333089:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333093:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938307.333101:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333107:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333116:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff910bc66c0d00) 00010000:00010000:1.0:1784938307.333118:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938307.333121:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333127:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee855 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333143:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333148:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333154:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333158:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938307.333160:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333166:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333172:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938307.333174:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938307.333183:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.333189:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee85c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938307.333822:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11300:x1871643125266176:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 1637us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938307.333834:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:0.0:1784938307.341119:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.341191:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125266432 00000100:00100000:3.0:1784938307.341207:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125266432 00000100:00100000:3.0:1784938307.341785:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:3.0:1784938307.341798:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11300:x1871643125266432:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938307.341825:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938307.341850:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee863 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28712 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.341980:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342001:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342013:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938307.342025:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784938307.342124:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342132:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342139:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342145:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938307.342150:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342158:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342188:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:3.0:1784938307.342190:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938307.342195:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342201:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee86a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342286:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee863 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28712 expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342296:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:3.0:1784938307.342299:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938307.342302:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee863 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28712 expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.342318:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0e00, rc 0) 00000100:00100000:3.0:1784938307.342394:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125266432:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 599us (1291us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1784938307.342401:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:3.0:1784938307.352753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938307.352892:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125266560 00000100:00100000:0.0:1784938307.352903:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125266560 00000100:00100000:0.0:1784938307.352972:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:0.0:1784938307.352983:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125266560:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784938307.353023:0:6512:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784938307.353157:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125266560:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 175us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938307.353165:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:0.0:1784938307.362641:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938307.362729:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125266816 00000100:00100000:1.0:1784938307.362739:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125266816 00000100:00100000:1.0:1784938307.362799:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:1.0:1784938307.362809:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125266816:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938307.362836:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938307.362841:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784938307.362870:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ee824 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28704 expref: 14 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.362890:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938307.362895:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938307.362910:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee878 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28719 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938307.364698:0:9526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1784938307.364901:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee87f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.364919:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee87f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.364950:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee87f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.365068:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee878 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28719 expref: 16 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.365090:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee87f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28719 expref: 15 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.365099:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910bc66c0d00) 00010000:00010000:1.0:1784938307.365101:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938307.365104:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215ae00, rc 0) 00000100:00100000:1.0:1784938307.365191:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11300:x1871643125266816:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 2383us (2560us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1784938307.365281:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:3.0:1784938307.372646:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938307.372725:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125267072 00000100:00100000:1.0:1784938307.372735:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125267072 00000100:00100000:1.0:1784938307.372796:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:1.0:1784938307.372805:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11300:x1871643125267072:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784938307.372866:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938307.372893:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee87f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28719 expref: 15 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.372916:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910bc66c0d00) 00010000:00010000:1.0:1784938307.372927:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938307.372949:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.372972:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.372982:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.372998:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373005:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373013:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373058:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373066:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373072:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373079:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938307.373084:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373092:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373101:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938307.373111:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938307.373116:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373122:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee88d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373132:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373138:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373144:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373150:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938307.373153:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373158:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373165:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xbff08ff1 (ffff910bc66c0600) 00010000:00010000:1.0:1784938307.373168:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938307.373171:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.373176:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ee894 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbff08ff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938307.373310:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125267072:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 505us (670us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938307.373323:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:1.0:1784938307.381527:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938307.381635:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125267200 00000100:00100000:2.0:1784938307.381645:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125267200 00000100:00100000:2.0:1784938307.381708:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 84 00000100:00100000:2.0:1784938307.381719:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125267200:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938307.381739:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938307.381764:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee89b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28720 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.381804:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.381818:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.381830:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.381943:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee89b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28720 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.381960:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28720 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.381974:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:2.0:1784938307.381977:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938307.381980:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1000, rc 0) 00000100:00100000:2.0:1784938307.382037:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11300:x1871643125267200:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 320us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938307.382043:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 84 00000100:00100000:1.0:1784938307.391748:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938307.391840:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125267456 00000100:00100000:0.0:1784938307.391851:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125267456 00000100:00100000:0.0:1784938307.391916:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:0.0:1784938307.391926:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11300:x1871643125267456:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784938307.392023:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.392042:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.392053:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784938307.392283:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1784938307.392294:0:9526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375424079246ns, next at 376424076914ns, rc = 0 00000004:00010000:0.0:1784938307.392347:0:9526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003942b140 reply state 00000000a3f01212 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.392361:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.392368:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:0.0:1784938307.392371:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784938307.392374:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938307.392898:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:11300:x1871643125267456:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 971us (1154us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1784938307.392907:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:2.0:1784938307.400795:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.402012:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125267584 00000100:00100000:3.0:1784938307.402024:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125267584 00000100:00100000:3.0:1784938307.402085:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:3.0:1784938307.402096:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:11300:x1871643125267584:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938307.402120:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938307.402151:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28727 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.402210:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28727 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.402249:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28727 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.402269:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:3.0:1784938307.402273:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938307.402276:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0e00, rc 0) 00000100:00100000:3.0:1784938307.402330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:11300:x1871643125267584:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 237us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938307.402336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:2.0:1784938307.406060:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938307.406144:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125267712 00000100:00100000:0.0:1784938307.406153:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125267712 00000100:00100000:0.0:1784938307.406231:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:0.0:1784938307.406242:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1871643125267712:12345-192.168.203.26@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1784938307.406281:0:8429:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:0.0:1784938307.406328:0:8429:0:(genops.c:1406:class_connect()) connect: client 263deb07-6496-49f7-9596-7a44f1bd8c2b, cookie 0x26783cd1c59ee8b7 00002000:00100000:0.0:1784938307.406347:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 263deb07-6496-49f7-9596-7a44f1bd8c2b/ffff910cc871f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784938307.406365:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784938307.406458:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784938307.406487:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910cc871a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938307.406550:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2391:x1871643125267712:12345-192.168.203.26@tcp:8:lhsmtool_posix.0 Request processed in 309us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938307.406559:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:0.0:1784938307.411061:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.411704:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125267840 00000100:00100000:3.0:1784938307.411715:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125267840 00000100:00100000:3.0:1784938307.411796:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:3.0:1784938307.411807:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:0:x1871643125267840:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1784938307.412147:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1784938307.423324:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1784938307.423339:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000100:00100000:3.0:1784938307.423484:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:0:x1871643125267840:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 11673us (12424us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784938307.423495:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:2.0:1784938307.437137:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938307.437485:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125268096 00000100:00100000:1.0:1784938307.437495:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125268096 00000100:00100000:1.0:1784938307.437590:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:1.0:1784938307.437600:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:11300:x1871643125268096:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784938307.437845:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11300:x1871643125268096:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 246us (715us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1784938307.437854:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1784938307.442948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938307.443537:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125268352 00000100:00100000:1.0:1784938307.443547:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125268352 00000100:00100000:1.0:1784938307.443658:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:1.0:1784938307.443670:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11300:x1871643125268352:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784938307.443785:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11300:x1871643125268352:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 117us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938307.443792:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:2.0:1784938307.451236:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.451333:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125268480 00000100:00100000:3.0:1784938307.451343:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125268480 00000100:00100000:3.0:1784938307.451406:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:3.0:1784938307.451424:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11300:x1871643125268480:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938307.451446:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938307.451467:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2872e expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.451551:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.451579:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.451591:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938307.451637:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938307.451656:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.451684:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2872e expref: 21 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.451922:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2872e expref: 20 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.451934:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:3.0:1784938307.451937:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784938307.451941:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1e00, rc 0) 00000100:00100000:3.0:1784938307.452006:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11300:x1871643125268480:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 584us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938307.452024:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:2.0:1784938307.457122:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938307.457684:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125268608 00000100:00100000:0.0:1784938307.458011:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125268608 00000100:00100000:0.0:1784938307.458076:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1784938307.458085:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125268608:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938307.458103:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938307.458127:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28735 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938307.458152:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63ff43, blocks: 0x0 00010000:00010000:0.0:1784938307.458170:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1784938307.458175:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938307.458184:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28735 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.458203:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28735 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.458245:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76e00, rc 0) 00000100:00100000:0.0:1784938307.459405:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125268608:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1313us (2284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938307.459417:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1784938307.468420:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.468502:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125268864 00000100:00100000:3.0:1784938307.468512:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125268864 00000100:00100000:3.0:1784938307.468585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:3.0:1784938307.468595:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11300:x1871643125268864:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784938307.468719:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11300:x1871643125268864:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 126us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938307.468727:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:3.0:1784938307.473031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938307.473121:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125268992 00000100:00100000:0.0:1784938307.473132:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125268992 00000100:00100000:0.0:1784938307.473191:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:0.0:1784938307.473202:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:11300:x1871643125268992:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938307.473251:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938307.473272:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2873c expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.473301:0:8770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28735 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.473310:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938307.473314:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938307.473319:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.473354:0:8770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28735 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.473368:0:8770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28735 expref: 7 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938307.473381:0:8770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1871643144234112:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938307.473521:0:8770:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938307.490482:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938307.490511:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125269120 00000100:00100000:0.0:1784938307.490518:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125269120 00010000:00010000:0.0:1784938307.490563:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28735 expref: 8 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938307.490606:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1784938307.490615:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125269120:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938307.490629:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938307.490649:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28735 expref: 8 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.490662:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28735 expref: 8 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.490686:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938307.491078:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938307.491089:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.491100:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.491134:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938307.491163:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc8759c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6500:1871643144234240:192.168.203.26@tcp:105: 00000100:00100000:0.0:1784938307.491265:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66ede40 going to sleep for 11 seconds 00010000:00010000:0.0:1784938307.491304:0:8770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ee8cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28735 expref: 8 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938307.491318:0:8770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1871643144234112:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938307.491340:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.491351:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76c00, rc 0) 00000100:00100000:0.0:1784938307.491377:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:11300:x1871643125268992:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 18177us (18356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938307.491384:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:1.0:1784938307.508664:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc8759c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6500:1871643144234240:192.168.203.26@tcp:105: 00010000:00010000:1.0:1784938307.509663:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938307.509737:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125269120:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 19119us (19260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938307.509747:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1784938307.510672:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938307.511683:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125269248 00000100:00100000:2.0:1784938307.512304:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125269248 00002000:00100000:2.0:1784938307.512358:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff910bc7f73b80 x1871643125269248/t0(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:538/0 lens 504/0 e 0 to 0 dl 1784938318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938307.512370:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc7f73b80 with x1871643125269248 ext(0->8) 00002000:00010000:2.0:1784938307.512376:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910bc7f73b80 00000100:00100000:2.0:1784938307.512403:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:2.0:1784938307.512413:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2393:x1871643125269248:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784938307.519902:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2393:x1871643125269248:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 7479us (9222us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784938307.519918:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00002000:00100000:2.0:1784938307.519946:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff910bc7f73b80 x1871643125269248/t4294967303(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:538/0 lens 504/448 e 0 to 0 dl 1784938318 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938307.519958:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc7f73b80 with x1871643125269248 ext(0->8) 00002000:00010000:2.0:1784938307.519965:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910bc7f73b80 00000100:00100000:1.0:1784938307.526540:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938307.526610:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125269376 00000100:00100000:1.0:1784938307.526620:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125269376 00000100:00100000:1.0:1784938307.526675:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:1.0:1784938307.526691:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11300:x1871643125269376:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784938307.531399:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1784938307.531418:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1784938307.531443:0:6492:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1784938307.531541:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1784938307.531553:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1784938307.531584:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144234368:192.168.203.126@tcp:2:osp-syn-1-0.0 00010000:00010000:3.0:1784938307.531861:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.531948:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.531957:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.531965:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938307.531970:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.531979:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.531995:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:3.0:1784938307.531998:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784938307.532002:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.532015:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee8a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938307.532436:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125269376:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 5745us (5903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938307.532446:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:1.0:1784938307.532741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938307.534105:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144234368 00000100:00100000:2.0:1784938307.534117:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144234368 00000100:00100000:2.0:1784938307.534186:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:2.0:1784938307.534195:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144234368:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 00000100:00080000:3.0:1784938307.534295:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1784938307.534342:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784938307.534346:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784938307 00002000:00010000:2.0:1784938307.534349:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784938307.534351:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1784938307 -> 1784938307 00002000:00010000:2.0:1784938307.534353:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1784938307.534409:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144234368:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 Request processed in 215us (1671us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784938307.534417:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 37 00000004:00080000:3.0:1784938307.539205:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910bc7768380/2, rc 0, transno 4294967304 00000100:00100000:3.0:1784938307.539242:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144234368:192.168.203.126@tcp:2:osp-syn-1-0.0 00000100:00100000:1.0:1784938307.541145:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.541244:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125269504 00000100:00100000:3.0:1784938307.541252:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125269504 00000100:00100000:0.0:1784938307.541496:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:0.0:1784938307.541508:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2395:x1871643125269504:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1784938307.542673:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1784938307.542684:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1784938307.542874:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125269504:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 1366us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938307.542884:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:2.0:1784938307.546162:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.546254:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125269760 00000100:00100000:3.0:1784938307.546263:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125269760 00000100:00100000:3.0:1784938307.546332:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 91 00000100:00100000:3.0:1784938307.546342:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125269760:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784938307.546395:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938307.546424:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2872e expref: 14 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.546441:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:3.0:1784938307.546447:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938307.546478:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.546491:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.546500:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938307.546705:0:13805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041b3ec0e reply state 0000000032eb693e transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.546719:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.546726:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:3.0:1784938307.546728:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938307.546730:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938307.546931:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11300:x1871643125269760:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 589us (777us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1784938307.546939:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 91 00000100:00100000:3.0:1784938307.551888:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938307.552078:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125269888 00000100:00100000:2.0:1784938307.552101:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125269888 00000100:00100000:2.0:1784938307.552162:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:2.0:1784938307.552172:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125269888:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784938307.552353:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1784938307.552357:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1784938307 -> 1784938305 00002000:00010000:2.0:1784938307.552360:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784938303 00002000:00010000:2.0:1784938307.552363:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1784938307 -> 1784938305 00002000:00010000:2.0:1784938307.552366:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1784938307.552425:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125269888:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 254us (545us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784938307.552433:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:1.0:1784938307.560580:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938307.560656:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125270144 00000100:00100000:0.0:1784938307.560667:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125270144 00000100:00100000:0.0:1784938307.560733:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 92 00000100:00100000:0.0:1784938307.560743:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:11300:x1871643125270144:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784938307.560827:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.560846:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28720 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.560856:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.560893:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28720 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.560907:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28720 expref: 15 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938307.560920:0:9526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1871643144234496:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938307.561005:0:9526:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938307.563922:0:9526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1871643144234496:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938307.563950:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938307.576874:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938307.577001:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125270272 00000100:00100000:0.0:1784938307.577010:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125270272 00010000:00010000:0.0:1784938307.577049:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28720 expref: 16 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938307.577092:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:0.0:1784938307.577102:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:2393:x1871643125270272:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938307.577132:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938307.577139:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28720 expref: 16 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.577158:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28720 expref: 16 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.577181:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ee8a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28720 expref: 16 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.577198:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:0.0:1784938307.577203:0:9518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.577258:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.577267:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.577297:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938307.577350:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:2393:x1871643125270272:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 248us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938307.577358:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00010000:00010000:3.0:1784938307.577803:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.577813:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.577856:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.577864:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.577871:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.577878:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938307.577882:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.577901:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.577911:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:3.0:1784938307.577914:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784938307.577918:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.577924:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee8e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938307.578019:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125270144:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 17233us (17413us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784938307.578028:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 92 00000100:00100000:1.0:1784938307.587067:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.587253:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125270400 00000100:00100000:3.0:1784938307.587263:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125270400 00000100:00100000:3.0:1784938307.587314:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1784938307.587325:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125270400:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784938307.587373:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.587397:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.587406:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938307.587410:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938307.587415:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.587470:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.587484:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 7 pid: 8770 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938307.587499:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1871643144234624:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938307.587597:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938307.591963:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938307.592142:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125270528 00000100:00100000:1.0:1784938307.592152:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125270528 00010000:00010000:1.0:1784938307.592192:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 8 pid: 8770 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938307.592267:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:1.0:1784938307.592277:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2393:x1871643125270528:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938307.592293:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938307.592316:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 8 pid: 8770 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.592329:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 8 pid: 8770 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.592355:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938307.592359:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938307.592365:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.592391:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.592413:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938307.592547:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ee8d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2873c expref: 8 pid: 8770 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938307.592563:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1871643144234624:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938307.592595:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.592606:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.592616:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.592636:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.592659:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.592670:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.592678:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938307.592682:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.592692:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.592703:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.592711:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f2dcd8a/0x26783cd1c59ee8e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938307.594805:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2393:x1871643125270528:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 2518us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938307.594820:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:3.0:1784938307.597559:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125270400:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 10223us (10490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938307.597582:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:1.0:1784938307.606913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.607013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125270784 00000100:00100000:3.0:1784938307.607024:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125270784 00000100:00100000:3.0:1784938307.607200:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 93 00000100:00100000:3.0:1784938307.607258:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11300:x1871643125270784:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784938307.607341:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.607357:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286c5 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.607368:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.607399:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286c5 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.607412:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286c5 expref: 14 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938307.607426:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144234752:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938307.607499:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938307.615621:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938307.615777:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125270912 00000100:00100000:1.0:1784938307.615787:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125270912 00010000:00010000:1.0:1784938307.615827:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286c5 expref: 15 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938307.615874:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:1.0:1784938307.615884:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:2393:x1871643125270912:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938307.615900:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938307.615907:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286c5 expref: 15 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.615919:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286c5 expref: 15 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.615941:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938307.615947:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.616005:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.616013:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.616033:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938307.616085:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:2393:x1871643125270912:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 202us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938307.616094:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00010000:00010000:3.0:1784938307.616374:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee72f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a286c5 expref: 14 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938307.616395:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144234752:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938307.616416:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.616426:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.616444:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.616660:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.616679:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28727 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.616687:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.616716:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28727 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.616730:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28727 expref: 14 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938307.616744:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144234880:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938307.616956:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938307.624411:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144234880:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938307.624443:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938307.627068:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938307.627476:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125271040 00000100:00100000:2.0:1784938307.627487:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125271040 00010000:00010000:2.0:1784938307.627530:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28727 expref: 15 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938307.627595:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:2.0:1784938307.627604:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:2393:x1871643125271040:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938307.627618:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938307.627625:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28727 expref: 15 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.627636:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28727 expref: 15 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.627658:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59ee8b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28727 expref: 15 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.627688:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:2.0:1784938307.627699:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.627709:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.627718:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.627987:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938307.628051:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:2393:x1871643125271040:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 446us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938307.628060:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00010000:00010000:3.0:1784938307.629048:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.629060:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938307.629337:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1784938307.629458:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1784938307.629499:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1784938307.629724:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1871643144235008:192.168.203.126@tcp:1000:mdt00_001.0 00000100:00100000:2.0:1784938307.629825:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc99590c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938307.630296:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938307.630377:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144235008 00000100:00100000:0.0:1784938307.630384:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144235008 00000100:00100000:0.0:1784938307.630436:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 179 00000100:00100000:0.0:1784938307.630445:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1871643144235008:12345-192.168.203.126@tcp:1000:mdt00_001.0 00000100:00100000:0.0:1784938307.630797:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1871643144235008:12345-192.168.203.126@tcp:1000:mdt00_001.0 Request processed in 122us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938307.630805:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 179 00000100:00100000:2.0:1784938307.631184:0:6513:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1784938307.631191:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910bc7768380, transno 4294967304 00000100:00100000:2.0:1784938307.631204:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1871643144235008:192.168.203.126@tcp:1000:mdt00_001.0 00000001:00080000:2.0:1784938307.631362:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1784938307.631417:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1871643144235136:192.168.203.126@tcp:1000:mdt00_001.0 00000100:00100000:2.0:1784938307.631465:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9959540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938307.635130:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938307.639990:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144235136 00000100:00100000:0.0:1784938307.640006:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144235136 00000100:00100000:0.0:1784938307.640069:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 180 00000100:00100000:0.0:1784938307.640081:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1871643144235136:12345-192.168.203.126@tcp:1000:mdt00_001.0 00000100:00100000:0.0:1784938307.640299:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6513:x1871643144235136:12345-192.168.203.126@tcp:1000:mdt00_001.0 Request processed in 219us (5179us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784938307.640307:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 180 00000100:00100000:0.0:1784938307.641055:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6513:1871643144235136:192.168.203.126@tcp:1000:mdt00_001.0 00010000:00010000:0.0:1784938307.641107:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641117:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641125:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641131:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938307.641137:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641145:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641161:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:0.0:1784938307.641179:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938307.641185:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641191:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ee8f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641272:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641279:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641285:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641289:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938307.641292:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641298:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641307:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938307.641309:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938307.641312:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641317:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ee82b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641340:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641363:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2870b expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641372:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641405:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2870b expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.641419:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2870b expref: 17 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938307.641434:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc8758000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144235264:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938307.641503:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66ed840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938307.649644:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938307.649744:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc8758000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144235264:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938307.649771:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938307.649934:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125271168 00000100:00100000:1.0:1784938307.649942:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125271168 00010000:00010000:1.0:1784938307.649978:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2870b expref: 18 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938307.650017:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:1.0:1784938307.650026:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:2392:x1871643125271168:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938307.650042:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938307.650049:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2870b expref: 18 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.650062:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2870b expref: 18 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.650085:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ee847 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2870b expref: 18 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.650115:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938307.650120:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.650129:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.650137:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938307.650168:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938307.650246:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:2392:x1871643125271168:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 220us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938307.650254:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00010000:00010000:2.0:1784938307.650920:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.650929:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.650940:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.650947:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.650954:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.650959:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938307.650963:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.650970:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.650981:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938307.650984:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938307.650988:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.650994:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ee8fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.651005:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.651025:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.651031:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.651036:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938307.651038:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.651044:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.651053:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938307.651055:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938307.651058:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938307.651063:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ee8ef lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938307.651260:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:11300:x1871643125270784:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 44001us (44354us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1784938307.651268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 93 00000020:00080000:2.0:1784938307.651273:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1784938307.652167:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938307.652174:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938307.652192:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1784938307.652200:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938307.656391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938307.656464:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125271424 00000100:00100000:3.0:1784938307.656474:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125271424 00000100:00100000:3.0:1784938307.656525:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:3.0:1784938307.656544:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:11300:x1871643125271424:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784938307.656830:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784938307.656865:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1784938307.656898:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.656915:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.656925:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.656933:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.656939:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.656944:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938307.656960:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938307.657056:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:11300:x1871643125271424:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 522us (672us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1784938307.657064:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000020:00080000:3.0:1784938307.657069:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784938307.658445:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938307.658458:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.658469:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938307.658473:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.658482:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.658517:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:0.0:1784938307.658520:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784938307.658526:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.658532:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59ee904 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938307.658562:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938307.658575:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938307.658577:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938308.191434:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938308.220421:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938308.220519:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938308.220577:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938308.220605:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938308.220627:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938308.220656:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125272064 00000100:00100000:3.0:1784938308.220665:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125272064 00000100:00100000:3.0:1784938308.220723:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125271680 00000100:00100000:3.0:1784938308.220727:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125271680 00000100:00100000:3.0:1784938308.220748:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125271936 00000100:00100000:3.0:1784938308.220751:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125271936 00000100:00100000:3.0:1784938308.220768:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 313 00000100:00100000:3.0:1784938308.220776:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125272064:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.220846:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125272064:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938308.220853:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 313 00000100:00100000:3.0:1784938308.220884:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 314 00000100:00100000:3.0:1784938308.220891:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125271680:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.220916:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125271680:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938308.220922:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 314 00000100:00100000:3.0:1784938308.220933:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 315 00000100:00100000:3.0:1784938308.220940:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125271936:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.220962:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125271936:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938308.220986:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 315 00000100:00080000:3.0:1784938308.221005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938308.221009:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938308.221851:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125271808 00000100:00100000:0.0:1784938308.221859:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125271808 00000100:00100000:0.0:1784938308.221912:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:0.0:1784938308.221921:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125271808:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.221971:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125271808:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 51us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938308.221977:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00080000:0.0:1784938308.225831:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938308.233412:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125271552 00000100:00100000:2.0:1784938308.233428:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125271552 00000100:00100000:2.0:1784938308.233494:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 388 00000100:00100000:2.0:1784938308.233504:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125271552:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938308.233895:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125271552:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 390us (13481us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938308.233903:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 388 00000100:00100000:1.0:1784938308.255500:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144235392:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938308.255851:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938308.256246:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144235392 00000100:00100000:1.0:1784938308.256254:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144235392 00000100:00100000:1.0:1784938308.256308:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 136 00000100:00100000:1.0:1784938308.256318:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144235392:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938308.256342:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1784938308.256393:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144235392:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 75us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938308.256416:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 136 00000100:00100000:1.0:1784938308.256575:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144235392:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938308.257365:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144235520:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938308.257848:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144235776:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.257968:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144236288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.257994:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144236800:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.258019:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784938308.258026:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144235648:0@lo:400:kworker.0 00000100:00100000:1.0:1784938308.258063:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938308.258171:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144235904:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.258241:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144236416:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.258267:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144236928:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.258288:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784938308.258294:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144236032:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.258317:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144236544:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.258354:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144237056:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.258631:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938308.259117:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144235648 00000100:00100000:2.0:1784938308.259125:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144235648 00000100:00100000:2.0:1784938308.259166:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1784938308.259175:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144235648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938308.264169:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938308.264247:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938308.264269:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938308.264294:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938308.264337:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144236288 00000100:00100000:3.0:1784938308.264346:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144236288 00000100:00100000:3.0:1784938308.264396:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144236928 00000100:00100000:3.0:1784938308.264399:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144236928 00000100:00100000:3.0:1784938308.264418:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 316 00000100:00100000:3.0:1784938308.264439:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144236288:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.264497:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144236288:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 61us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938308.264504:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 316 00000100:00100000:3.0:1784938308.264520:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 317 00000100:00100000:3.0:1784938308.264526:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144236928:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.264557:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144236928:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938308.265071:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144237056 00000100:00100000:0.0:1784938308.265076:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144237056 00000100:00100000:0.0:1784938308.265109:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 121 00000100:00100000:0.0:1784938308.265116:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144237056:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.265142:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144237056:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938308.265148:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 121 00000100:00100000:0.0:1784938308.265170:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938308.265248:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938308.265266:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938308.265340:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938308.265363:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938308.265376:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144236544 00000100:00100000:0.0:1784938308.265379:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144236544 00000100:00100000:0.0:1784938308.265400:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 122 00000100:00100000:0.0:1784938308.265405:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144236544:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.265438:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144236544:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938308.265444:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 122 00010000:00080000:0.0:1784938308.265501:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2075180 x1871643144236928/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938308.265516:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144236928:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.265855:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144236544:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.265963:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144237056:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.266002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144235776 00000100:00100000:0.0:1784938308.266005:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144235776 00000100:00100000:0.0:1784938308.266021:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144236800 00000100:00100000:0.0:1784938308.266023:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144236800 00000100:00100000:0.0:1784938308.266033:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144236416 00000100:00100000:0.0:1784938308.266034:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144236416 00000100:00100000:0.0:1784938308.266043:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144236032 00000100:00100000:0.0:1784938308.266045:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144236032 00000100:00100000:0.0:1784938308.266057:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 318 00000100:00100000:0.0:1784938308.266062:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144235776:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.266089:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144235776:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938308.266095:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 318 00000100:00100000:0.0:1784938308.266105:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 319 00000100:00100000:0.0:1784938308.266110:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144236800:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.266126:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144236800:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938308.266131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 319 00000100:00100000:0.0:1784938308.266140:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 320 00000100:00100000:0.0:1784938308.266145:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144236416:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.266159:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144236416:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 15us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938308.266165:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 320 00000100:00100000:0.0:1784938308.266181:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 321 00000100:00100000:0.0:1784938308.266261:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144236032:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.266284:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144236032:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 98us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938308.266289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 321 00000100:00100000:0.0:1784938308.266307:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144235904 00000100:00100000:0.0:1784938308.266310:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144235904 00000100:00100000:0.0:1784938308.266331:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 181 00000100:00100000:0.0:1784938308.266336:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144235904:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938308.266357:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144235904:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938308.266362:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 181 00000100:00100000:3.0:1784938308.266747:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 317 00000100:00080000:3.0:1784938308.266770:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938308.266774:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938308.266777:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938308.266779:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938308.267652:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144236032:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.267667:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144235904:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938308.267679:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2075c00 x1871643144236416/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938308.267892:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144236160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.267952:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144236672:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.267982:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144235776:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.267994:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144236288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.268002:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144236800:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.268127:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938308.268151:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938308.268178:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144236160 00000100:00100000:1.0:1784938308.268184:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144236160 00000100:00100000:1.0:1784938308.268250:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 182 00000100:00100000:1.0:1784938308.268258:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144236160:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.268293:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144236160:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938308.268309:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 182 00000100:00100000:1.0:1784938308.268349:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144236672 00000100:00100000:1.0:1784938308.268353:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144236672 00000100:00100000:1.0:1784938308.268384:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 123 00000100:00100000:1.0:1784938308.268389:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3641:x1871643144236672:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938308.268415:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3641:x1871643144236672:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938308.268434:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 123 00000100:00100000:1.0:1784938308.268474:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144235520 00000100:00100000:1.0:1784938308.268477:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144235520 00000100:00100000:1.0:1784938308.268497:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 137 00000100:00100000:1.0:1784938308.268502:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfdb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144235520:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938308.268528:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1784938308.269002:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfdb93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144235520:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 497us (10369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938308.269008:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 137 00000100:00100000:3.0:1784938308.269276:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144236416:192.168.203.126@tcp:400:kworker.0 00000100:00080000:3.0:1784938308.269304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938308.269609:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144235648:12345-0@lo:400:kworker.0 Request processed in 10432us (11542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938308.269618:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1784938308.270024:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144235648:0@lo:400:kworker.0 00000100:00100000:2.0:1784938308.275263:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144235520:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938308.275738:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144236160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.275754:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144236672:192.168.203.126@tcp:400:kworker.0 00000040:00080000:3.0:1784938309.185091:0:14259:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938309.185100:0:14259:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938309.185494:0:14259:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784938309.185503:0:14259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784938309.221297:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938309.280507:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144237184:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938309.280753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938309.280778:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144237184 00000100:00100000:1.0:1784938309.280784:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144237184 00000100:00100000:1.0:1784938309.280823:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 138 00000100:00100000:1.0:1784938309.280831:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144237184:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938309.280858:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938309.280911:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144237184:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938309.280918:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 138 00000100:00100000:1.0:1784938309.281291:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144237184:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938309.281305:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938309.281311:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144237312:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938309.281392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938309.281409:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144237312 00000100:00100000:1.0:1784938309.281412:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144237312 00000100:00100000:1.0:1784938309.281431:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 139 00000100:00100000:1.0:1784938309.281437:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1871643144237312:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938309.281447:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938309.281468:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1871643144237312:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 31us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938309.281473:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 139 00000100:00100000:1.0:1784938309.281549:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144237312:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938309.446177:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938309.446290:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125272320 00000100:00100000:0.0:1784938309.446300:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125272320 00000100:00100000:0.0:1784938309.446387:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:0.0:1784938309.446398:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:11319:x1871643125272320:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938309.446426:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938309.446448:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee90b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28743 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.446581:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee912 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.446595:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.446606:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938309.446635:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784938309.446750:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee90b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28743 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.446770:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee912 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28743 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.446778:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:0.0:1784938309.446781:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784938309.446785:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77600, rc 0) 00000100:00100000:0.0:1784938309.446854:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11319:x1871643125272320:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 458us (687us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1784938309.446861:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00080000:3.0:1784938309.446997:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938309.450608:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938309.450848:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125272448 00000100:00100000:3.0:1784938309.450857:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125272448 00000100:00100000:3.0:1784938309.450914:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:3.0:1784938309.450924:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11319:x1871643125272448:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:3.0:1784938309.451002:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451019:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451030:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451075:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451084:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451092:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451170:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451178:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451184:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938309.451265:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451279:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451287:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451297:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451305:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938309.451309:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451325:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451338:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:3.0:1784938309.451342:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938309.451347:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451354:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee920 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451368:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451374:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451379:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451383:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938309.451386:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451391:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451397:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910cc2a19b00) 00010000:00010000:3.0:1784938309.451399:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938309.451402:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451417:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee927 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451433:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451440:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451446:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451450:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938309.451453:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451458:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451466:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19100) 00010000:00010000:3.0:1784938309.451468:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938309.451471:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.451476:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee92e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938309.455379:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11319:x1871643125272448:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 4444us (4775us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.455393:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:2.0:1784938309.539352:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938309.539449:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125272704 00000100:00100000:3.0:1784938309.539460:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125272704 00000100:00100000:3.0:1784938309.539526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:3.0:1784938309.539536:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11322:x1871643125272704:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938309.539578:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938309.539600:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee935 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2874a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539697:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539712:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539723:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539737:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539743:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539749:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539856:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539864:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539871:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938309.539886:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784938309.539984:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539993:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.539999:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540004:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938309.540009:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540016:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540028:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:3.0:1784938309.540032:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938309.540036:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540043:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee93c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540058:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540064:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540071:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540303:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938309.540313:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540321:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540330:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910cc2a19100) 00010000:00010000:3.0:1784938309.540333:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938309.540336:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540343:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee943 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540385:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee935 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2874a expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540400:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2874a expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.540408:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:3.0:1784938309.540410:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938309.540413:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0a00, rc 0) 00000100:00100000:3.0:1784938309.540483:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11322:x1871643125272704:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 947us (1139us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1784938309.540491:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:3.0:1784938309.549528:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938309.549650:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125272832 00000100:00100000:0.0:1784938309.549660:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125272832 00000100:00100000:0.0:1784938309.549725:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:0.0:1784938309.549734:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11322:x1871643125272832:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1784938309.549803:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.549820:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.549831:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.549867:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.549889:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.549896:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.549902:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938309.549906:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.549914:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.549928:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:0.0:1784938309.549930:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938309.549936:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.549942:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee958 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938309.550305:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11322:x1871643125272832:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 570us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.550314:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:2.0:1784938309.552151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938309.552395:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125273088 00000100:00100000:3.0:1784938309.552405:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125273088 00000100:00100000:3.0:1784938309.552452:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:3.0:1784938309.552477:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11322:x1871643125273088:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1784938309.552723:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:11322:x1871643125273088:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 247us (578us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1784938309.552732:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:3.0:1784938309.590020:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938309.591474:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125273344 00000100:00100000:2.0:1784938309.591490:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125273344 00000100:00100000:2.0:1784938309.591577:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:2.0:1784938309.591588:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:10838:x1871643125273344:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1784938309.591613:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938309.591635:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee95f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28751 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.591769:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.591783:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2874a expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.591792:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.591826:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2874a expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.591840:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2874a expref: 24 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938309.591854:0:9526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1871643144237440:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938309.591964:0:9526:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7335a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938309.595602:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938309.596013:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125273472 00000100:00100000:0.0:1784938309.596026:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125273472 00010000:00010000:0.0:1784938309.596084:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2874a expref: 25 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938309.596140:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:0.0:1784938309.596170:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:2393:x1871643125273472:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938309.596189:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938309.596197:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2874a expref: 25 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.596246:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2874a expref: 25 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.596276:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:0.0:1784938309.596283:0:9518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.596294:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.596303:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.596340:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938309.596413:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:2393:x1871643125273472:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 245us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.596421:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00010000:00010000:2.0:1784938309.597284:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ee94a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2874a expref: 24 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938309.597320:0:9526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1871643144237440:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938309.597349:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.597359:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.597382:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938309.597406:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1784938309.597613:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59ee95f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28751 expref: 25 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.597634:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28751 expref: 24 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.597642:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:2.0:1784938309.597645:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938309.597649:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0a00, rc 0) 00000100:00100000:2.0:1784938309.597948:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:10838:x1871643125273344:12345-192.168.203.26@tcp:101:bash.0 Request processed in 6360us (7943us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1784938309.597959:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:3.0:1784938309.608278:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938309.608880:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125273600 00000100:00100000:0.0:1784938309.608898:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125273600 00000100:00100000:0.0:1784938309.609634:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 99 00000100:00100000:0.0:1784938309.609656:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:10838:x1871643125273600:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1784938309.609695:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938309.609729:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee974 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28758 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.609809:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee97b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.609831:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee97b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.609845:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee97b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.609997:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ee974 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28758 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.610023:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee97b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28758 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.610033:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:0.0:1784938309.610037:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784938309.610042:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76e00, rc 0) 00000100:00100000:0.0:1784938309.610250:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:10838:x1871643125273600:12345-192.168.203.26@tcp:101:bash.0 Request processed in 604us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.610260:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 99 00000100:00100000:0.0:1784938309.617834:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938309.618053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125273856 00000100:00100000:1.0:1784938309.618068:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125273856 00000100:00100000:1.0:1784938309.618149:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 100 00000100:00100000:1.0:1784938309.618161:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:10838:x1871643125273856:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:1.0:1784938309.618539:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.618597:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.618614:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938309.618684:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1784938309.618714:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fac67c0 reply state 00000000daebcd28 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.618730:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.618739:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:1.0:1784938309.618743:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938309.618748:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784938309.618790:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1784938309.618931:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:10838:x1871643125273856:12345-192.168.203.26@tcp:36:bash.0 Request processed in 769us (1109us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1784938309.618940:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 100 00000020:00080000:1.0:1784938309.618947:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1784938309.625459:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938309.625604:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125273984 00000100:00100000:2.0:1784938309.625617:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125273984 00000100:00100000:2.0:1784938309.625700:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:2.0:1784938309.625711:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0190ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:10838:x1871643125273984:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1784938309.625745:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938309.625773:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee989 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2875f expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.625860:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee989 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2875f expref: 30 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.625904:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee989 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2875f expref: 30 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.625931:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:2.0:1784938309.625934:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938309.625939:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1c00, rc 0) 00000100:00100000:2.0:1784938309.626031:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0190ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:10838:x1871643125273984:12345-192.168.203.26@tcp:101:bash.0 Request processed in 320us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.626039:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:2.0:1784938309.632647:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938309.632851:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125274112 00000100:00100000:0.0:1784938309.632864:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125274112 00000100:00100000:0.0:1784938309.632975:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1784938309.632987:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:10838:x1871643125274112:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1784938309.633013:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938309.633063:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28766 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938309.633099:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a63ff41, atime: 0x6a63ff3f, ctime: 0x6a63ff41, blocks: 0x8 00010000:00010000:0.0:1784938309.633128:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1784938309.633133:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938309.633403:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28766 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.633432:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28766 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.633448:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77800, rc 0) 00000100:00100000:0.0:1784938309.633527:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:10838:x1871643125274112:12345-192.168.203.26@tcp:101:bash.0 Request processed in 542us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.633535:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00080000:3.0:1784938309.633811:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938309.638914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938309.639413:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125274240 00000100:00100000:0.0:1784938309.639429:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125274240 00002000:00010000:0.0:1784938309.639489:0:8434:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1784938309.639495:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910d01908000 with x1871643125274240 ext(0->18446744073709551615) 00002000:00010000:0.0:1784938309.639512:0:8434:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d01908000. 00000100:00100000:0.0:1784938309.639629:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:0.0:1784938309.639642:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2394:x1871643125274240:12345-192.168.203.26@tcp:10:bash.0 00002000:00010000:0.0:1784938309.640047:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1784938309.640052:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1784938305 -> 1784938309 00002000:00010000:0.0:1784938309.640054:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1784938303 -> 1784938303 00002000:00010000:0.0:1784938309.640064:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1784938305 -> 1784938309 00002000:00010000:0.0:1784938309.640067:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1784938309.640870:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2394:x1871643125274240:12345-192.168.203.26@tcp:10:bash.0 Request processed in 1221us (1962us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1784938309.640883:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00002000:00010000:0.0:1784938309.640889:0:8434:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1784938309.640892:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910d01908000 with x1871643125274240 ext(0->18446744073709551615) 00002000:00010000:0.0:1784938309.640902:0:8434:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d01908000. 00000100:00100000:2.0:1784938309.742567:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938309.742660:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125274368 00000100:00100000:1.0:1784938309.742673:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125274368 00000100:00100000:1.0:1784938309.742816:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:1.0:1784938309.742828:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:11336:x1871643125274368:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1784938309.742933:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.742958:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.742992:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743010:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743017:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743024:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743121:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743132:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743139:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938309.743199:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743264:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743272:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743279:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743296:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215bc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938309.743301:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743309:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743324:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938309.743328:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938309.743334:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743341:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee997 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743357:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743364:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743370:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743375:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938309.743378:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743383:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743560:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0600) 00010000:00010000:1.0:1784938309.743562:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938309.743566:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743571:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ee99e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743590:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743596:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743602:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743606:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938309.743609:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743615:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743622:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:1.0:1784938309.743624:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938309.743627:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.743633:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938309.743827:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:11336:x1871643125274368:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 998us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938309.743837:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:2.0:1784938309.792829:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938309.793612:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125274624 00000100:00100000:3.0:1784938309.793629:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125274624 00000100:00100000:3.0:1784938309.793987:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:3.0:1784938309.794001:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:11339:x1871643125274624:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938309.794031:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938309.794060:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee9ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2876d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.794160:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.794179:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.794193:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.794210:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.794275:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.794283:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.794435:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ee9c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.794447:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ee9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.794455:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ee9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938309.794467:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784938309.798317:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798342:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798351:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798358:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938309.798365:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798373:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798441:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:3.0:1784938309.798445:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938309.798451:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798459:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ee9b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798482:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798489:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798494:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798500:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938309.798503:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798510:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798517:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910cc2a19100) 00010000:00010000:3.0:1784938309.798520:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938309.798523:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.798529:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59ee9ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.800574:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ee9ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2876d expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.800608:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ee9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2876d expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.800619:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:3.0:1784938309.800622:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784938309.800626:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0600, rc 0) 00000100:00100000:3.0:1784938309.800734:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:11339:x1871643125274624:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 6735us (7918us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1784938309.800745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:3.0:1784938309.808011:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000001:00080000:0.0:1784938309.808201:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1784938309.808262:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:1.0:1784938309.808982:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125274752 00000100:00100000:1.0:1784938309.808998:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125274752 00000100:00100000:1.0:1784938309.809082:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:1.0:1784938309.809095:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:11339:x1871643125274752:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1784938309.809194:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.809375:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28751 expref: 32 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.809388:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.809970:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28751 expref: 32 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.809993:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28751 expref: 32 pid: 9526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938309.810013:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2077b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144237568:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938309.810161:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc997c300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.816141:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938309.816270:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125275008 00000100:00100000:3.0:1784938309.816350:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125275008 00000100:00100000:3.0:1784938309.816579:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:3.0:1784938309.816593:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:6164:x1871643125275008:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784938309.817193:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:6164:x1871643125275008:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 600us (1058us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1784938309.817204:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:3.0:1784938309.820105:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938309.820353:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125275136 00000100:00100000:2.0:1784938309.820366:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125275136 00000100:00100000:1.0:1784938309.820426:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2077b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144237568:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938309.820439:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28751 expref: 34 pid: 9526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.820461:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938309.820506:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1784938309.820519:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:2393:x1871643125275136:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938309.820539:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938309.820548:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28751 expref: 34 pid: 9526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.820575:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28751 expref: 34 pid: 9526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.820617:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee966 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28751 expref: 34 pid: 9526 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.820637:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:2.0:1784938309.820643:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.820655:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.820664:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.820696:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938309.820807:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.820817:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.820859:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.820878:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.820885:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.820891:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938309.820895:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.820901:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938309.820912:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:2393:x1871643125275136:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 249us (676us total) trans 0 rc 0/0 00010000:00010000:1.0:1784938309.820919:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00000100:00100000:2.0:1784938309.820926:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00010000:00010000:1.0:1784938309.820927:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938309.820937:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.820945:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938309.821026:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:11339:x1871643125274752:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 11933us (13030us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938309.821044:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:0.0:1784938309.825387:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938309.825655:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125275392 00000100:00100000:2.0:1784938309.825668:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125275392 00000100:00100000:2.0:1784938309.825744:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1784938309.825757:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:11339:x1871643125275392:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1784938309.826085:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:11339:x1871643125275392:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 330us (711us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1784938309.826094:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1784938309.906869:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938309.907024:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125275648 00000100:00100000:1.0:1784938309.907038:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125275648 00000100:00100000:1.0:1784938309.907123:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:1.0:1784938309.907134:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:11350:x1871643125275648:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:1.0:1784938309.907168:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938309.907198:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28774 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.907338:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.907357:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.907371:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.907388:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.907395:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.907401:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908159:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee9eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908205:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908240:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938309.908256:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1784938309.908370:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908378:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908385:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908392:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215bc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938309.908397:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908406:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908423:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938309.908427:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938309.908432:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908439:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ee9dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908455:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908467:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908473:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908478:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938309.908481:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908488:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908496:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0800) 00010000:00010000:1.0:1784938309.908499:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938309.908502:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908508:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ee9e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.908998:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ee9d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28774 expref: 36 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.909019:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee9eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28774 expref: 35 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.909027:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:1.0:1784938309.909030:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938309.909042:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b800, rc 0) 00000100:00100000:1.0:1784938309.909140:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:11350:x1871643125275648:12345-192.168.203.26@tcp:101:cat.0 Request processed in 2007us (2286us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1784938309.909151:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:1.0:1784938309.915660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938309.915943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125275904 00000100:00100000:2.0:1784938309.915958:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125275904 00000100:00100000:2.0:1784938309.916033:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1784938309.916064:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:11350:x1871643125275904:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:2.0:1784938309.916503:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+36:11350:x1871643125275904:12345-192.168.203.26@tcp:35:cat.0 Request processed in 440us (856us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1784938309.916512:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:3.0:1784938309.939803:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938309.939995:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125276160 00000100:00100000:2.0:1784938309.940010:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125276160 00000100:00100000:2.0:1784938309.940092:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:2.0:1784938309.940104:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+36:11351:x1871643125276160:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:2.0:1784938309.940191:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1784938309.940258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59ee989 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2875f expref: 36 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940287:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ee9eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28774 expref: 35 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940301:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ee9c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2876d expref: 34 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940317:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ee97b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28758 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940329:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:2.0:1784938309.940336:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938309.940364:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940381:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940412:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940430:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940437:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940443:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940949:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940962:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.940970:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938309.941314:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1784938309.941327:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377973111697ns, next at 378973108671ns, rc = 0 00010000:00010000:2.0:1784938309.941390:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941399:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941407:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941431:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941438:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941445:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941485:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938309.941509:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941515:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941521:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941527:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938309.941533:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.941542:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.942045:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938309.942054:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.942071:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938309.942076:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.942083:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.942100:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:3.0:1784938309.942103:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938309.942108:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.942114:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eea0e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.942131:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938309.942133:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938309.942135:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938309.942203:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:2.0:1784938309.942206:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938309.942210:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942313:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea07 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942333:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942339:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942345:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942349:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938309.942352:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942358:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942368:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:2.0:1784938309.942371:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938309.942375:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942380:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ee9f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938309.942390:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7ea44f7 reply state 00000000dd890bd9 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942403:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.942418:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc73b3500) 00010000:00010000:2.0:1784938309.942420:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938309.942424:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938309.943290:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:11351:x1871643125276160:12345-192.168.203.26@tcp:36:rm.0 Request processed in 2440us (2758us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1784938309.943309:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:0.0:1784938310.038087:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.038211:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125276416 00000100:00100000:1.0:1784938310.038256:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125276416 00000100:00100000:1.0:1784938310.038342:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 107 00000100:00100000:1.0:1784938310.038355:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:11357:x1871643125276416:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938310.038390:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938310.038419:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eea15 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2877b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.038600:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.038620:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.038636:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.038648:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.038656:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.038663:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938310.039127:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1784938310.039361:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039373:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039382:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039426:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039434:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039441:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039448:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215bc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938310.039453:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039461:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039475:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938310.039479:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938310.039485:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039508:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea1c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938310.039529:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a25912a4 reply state 000000005eb2a85f transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039542:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039560:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc73b3500) 00010000:00010000:1.0:1784938310.039563:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938310.039567:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938310.039609:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eea15 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2877b expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039629:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2877b expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.039638:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0800) 00010000:00010000:1.0:1784938310.039640:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938310.039643:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b600, rc 0) 00000100:00100000:1.0:1784938310.039745:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:11357:x1871643125276416:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1392us (1670us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1784938310.039755:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 107 00000100:00100000:1.0:1784938310.045466:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938310.045588:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125276544 00000100:00100000:0.0:1784938310.045603:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125276544 00000100:00100000:0.0:1784938310.045714:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:0.0:1784938310.045728:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125276544:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1784938310.045754:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938310.045795:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28782 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938310.045838:0:8770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:3.0:1784938310.045952:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784938310.046155:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1784938310.046162:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938310.046175:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28782 expref: 6 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.046201:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28782 expref: 6 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.046259:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76000, rc 0) 00000100:00100000:0.0:1784938310.046340:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2393:x1871643125276544:12345-192.168.203.26@tcp:101:bash.0 Request processed in 615us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938310.046348:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:3.0:1784938310.052368:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938310.053034:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125276672 00000100:00100000:0.0:1784938310.053048:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125276672 00000100:00100000:0.0:1784938310.053187:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:0.0:1784938310.053200:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:11357:x1871643125276672:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1784938310.053264:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938310.053290:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28789 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.053335:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28782 expref: 7 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.053346:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938310.053350:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938310.053356:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.053398:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28782 expref: 7 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.053414:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28782 expref: 7 pid: 8770 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938310.053450:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1871643144237696:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938310.053602:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938310.070728:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1871643144237696:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938310.070787:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.070823:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76600, rc 0) 00000100:00100000:0.0:1784938310.071064:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:11357:x1871643125276672:12345-192.168.203.26@tcp:101:bash.0 Request processed in 17866us (18709us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938310.071074:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:3.0:1784938310.072776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938310.073059:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125276800 00000100:00100000:0.0:1784938310.073072:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125276800 00010000:00010000:0.0:1784938310.073125:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28782 expref: 7 pid: 8770 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938310.073183:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:0.0:1784938310.073195:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2393:x1871643125276800:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938310.073246:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938310.073277:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28782 expref: 7 pid: 8770 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.073292:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28782 expref: 7 pid: 8770 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.073342:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000361e6a85/0x26783cd1c59eea38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28782 expref: 7 pid: 8770 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.073362:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938310.073367:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938310.073376:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.073386:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.073431:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938310.073448:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1871643144237824:192.168.203.26@tcp:105: 00000100:00100000:0.0:1784938310.073560:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938310.080119:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1871643144237824:192.168.203.26@tcp:105: 00010000:00010000:0.0:1784938310.080156:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938310.080412:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2393:x1871643125276800:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 7217us (7652us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938310.080425:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:3.0:1784938310.081482:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938310.082762:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125277056 00000100:00100000:2.0:1784938310.082781:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125277056 00000100:00100000:2.0:1784938310.082939:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:2.0:1784938310.082953:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:11357:x1871643125277056:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:2.0:1784938310.083407:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:11357:x1871643125277056:12345-192.168.203.26@tcp:35:bash.0 Request processed in 456us (1931us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1784938310.083417:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00010000:00010000:3.0:1784938310.243593:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938310.262523:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.262731:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125277184 00000100:00100000:1.0:1784938310.262746:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125277184 00000100:00100000:1.0:1784938310.262841:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 108 00000100:00100000:1.0:1784938310.262867:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:11373:x1871643125277184:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938310.262901:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938310.262937:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eea46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28790 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.263019:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.263038:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.263051:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938310.263105:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784938310.263110:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938310.263134:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.263163:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eea46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28790 expref: 40 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.263188:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28790 expref: 39 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.263198:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938310.263201:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938310.263206:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215bc00, rc 0) 00000100:00100000:1.0:1784938310.263349:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:11373:x1871643125277184:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 484us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.263366:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 108 00000100:00100000:0.0:1784938310.271642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938310.272046:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125277440 00000100:00100000:2.0:1784938310.272060:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125277440 00000100:00100000:2.0:1784938310.272149:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 109 00000100:00100000:2.0:1784938310.272161:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:11373:x1871643125277440:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938310.272191:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938310.272259:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eea54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28797 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.272407:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.272425:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.272462:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938310.272477:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784938310.272628:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eea54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28797 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.272653:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28797 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.272663:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0800) 00010000:00010000:2.0:1784938310.272666:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938310.272671:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0400, rc 0) 00000100:00100000:2.0:1784938310.272758:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+41:11373:x1871643125277440:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 598us (1129us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1784938310.272767:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 109 00000100:00100000:3.0:1784938310.276956:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938310.277009:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.277130:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125277824 00000100:00100000:1.0:1784938310.277144:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125277824 00000100:00100000:1.0:1784938310.277265:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:1.0:1784938310.277277:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+41:2395:x1871643125277824:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938310.277298:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938310.277331:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eea5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28797 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.277356:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0800) 00010000:00010000:1.0:1784938310.277363:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938310.277430:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+40:2395:x1871643125277824:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 155us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.277437:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1784938310.278643:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125277696 00000100:00100000:2.0:1784938310.278661:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125277696 00000100:00100000:2.0:1784938310.278742:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 110 00000100:00100000:2.0:1784938310.278754:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+40:11373:x1871643125277696:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938310.278791:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938310.278819:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eea69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2879e expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.278966:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eea70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.279006:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eea70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.279020:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eea70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938310.279036:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784938310.279167:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eea69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2879e expref: 43 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.279188:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eea70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2879e expref: 42 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.279197:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0800) 00010000:00010000:2.0:1784938310.279200:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784938310.279204:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0e00, rc 0) 00000100:00100000:2.0:1784938310.279302:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+42:11373:x1871643125277696:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 550us (2361us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1784938310.279310:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 110 00000100:00100000:3.0:1784938310.288037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.288132:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125277952 00000100:00100000:1.0:1784938310.288146:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125277952 00000100:00100000:1.0:1784938310.288244:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:1.0:1784938310.288255:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2393:x1871643125277952:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:1.0:1784938310.288316:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.288505:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.288516:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938310.288522:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938310.288545:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.288668:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.288754:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 6 pid: 8429 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.288774:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2076680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1871643144237952:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938310.291517:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc12ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938310.308491:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938310.308528:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144238080:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938310.308763:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2076680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1871643144237952:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938310.308802:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.314187:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938310.314501:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125278080 00000100:00100000:3.0:1784938310.314515:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125278080 00002000:00100000:3.0:1784938310.314619:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff910cd2074a80 x1871643125278080/t0(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:541/0 lens 504/0 e 0 to 0 dl 1784938321 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938310.314631:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cd2074a80 with x1871643125278080 ext(0->8) 00010000:00010000:3.0:1784938310.314643:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 7 pid: 8429 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.314664:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 7 pid: 8429 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938310.314682:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910cd2074a80 00000100:00100000:3.0:1784938310.314722:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:3.0:1784938310.314732:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2393:x1871643125278080:12345-192.168.203.26@tcp:4:lfs.0 00000100:00100000:3.0:1784938310.318934:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125278080:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 4186us (4747us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784938310.318954:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00002000:00100000:3.0:1784938310.318971:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff910cd2074a80 x1871643125278080/t4294967303(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:541/0 lens 504/448 e 0 to 0 dl 1784938321 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938310.318982:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cd2074a80 with x1871643125278080 ext(0->8) 00010000:00010000:3.0:1784938310.318995:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 9 pid: 8429 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.319020:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 9 pid: 8429 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938310.319029:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910cd2074a80 00000100:00100000:3.0:1784938310.328116:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938310.328321:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938310.328377:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144238080 00000100:00100000:3.0:1784938310.328387:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144238080 00000100:00100000:3.0:1784938310.328454:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 183 00000100:00100000:3.0:1784938310.328466:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144238080:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938310.328518:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1784938310.328616:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144238080:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 153us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938310.328624:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 183 00000100:00100000:0.0:1784938310.329702:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125278208 00000100:00100000:0.0:1784938310.329716:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125278208 00010000:00010000:0.0:1784938310.329766:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 9 pid: 8429 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938310.329820:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:0.0:1784938310.329829:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2395:x1871643125278208:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938310.329847:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784938310.329872:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784938310.329875:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784938309 00002000:00010000:0.0:1784938310.329877:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784938310 00002000:00010000:0.0:1784938310.329879:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1784938309 00002000:00010000:0.0:1784938310.329881:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784938310.329888:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 9 pid: 8429 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.329902:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 9 pid: 8429 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.329930:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59eea3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28789 expref: 9 pid: 8429 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.329951:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938310.329956:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938310.329962:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.329991:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.330032:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938310.330091:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2395:x1871643125278208:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 263us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938310.330098:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:0.0:1784938310.330263:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144238080:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:3.0:1784938310.330487:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.330570:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.330596:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.330604:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.330613:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.330620:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938310.330625:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.330643:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.330657:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.330665:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59eea7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938310.330740:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2393:x1871643125277952:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 42486us (42720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938310.330748:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:1.0:1784938310.332915:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938310.333979:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125278464 00000100:00100000:3.0:1784938310.333998:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125278464 00000100:00100000:3.0:1784938310.334806:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:3.0:1784938310.334828:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+42:11373:x1871643125278464:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:3.0:1784938310.334923:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eea70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2879e expref: 42 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938310.335180:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1784938310.335240:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1784938310.336850:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1784938310.336945:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.336970:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2877b expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.336995:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.337044:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2877b expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.337064:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2877b expref: 46 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938310.337084:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1871643144238208:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938310.338795:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938310.344203:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1871643144238208:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938310.344285:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.347539:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938310.348083:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125278592 00000100:00100000:0.0:1784938310.348095:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125278592 00010000:00010000:0.0:1784938310.348148:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2877b expref: 47 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938310.348199:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:0.0:1784938310.348209:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+47:2392:x1871643125278592:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938310.348278:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938310.348286:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2877b expref: 47 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.348302:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2877b expref: 47 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.348526:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2877b expref: 47 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.348581:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0800) 00010000:00010000:0.0:1784938310.348588:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.348599:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.348608:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.348643:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938310.348730:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+46:2392:x1871643125278592:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 521us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938310.348738:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00010000:00010000:3.0:1784938310.349148:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.349158:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938310.349333:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1784938310.349472:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1784938310.349597:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb55180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144238336:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784938310.349690:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938310.349968:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938310.350722:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144238336 00000100:00100000:0.0:1784938310.350735:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144238336 00000100:00100000:0.0:1784938310.350929:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 184 00000100:00100000:0.0:1784938310.350942:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1871643144238336:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784938310.351083:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1871643144238336:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 Request processed in 144us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938310.351091:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 184 00000100:00100000:0.0:1784938310.354945:0:6515:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1784938310.354962:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1784938310.354994:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910cc875ea00, transno 4294967302 00000100:00100000:0.0:1784938310.355024:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb55180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144238336:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784938310.355268:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1784938310.355387:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144238464:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784938310.355481:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938310.356249:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938310.356336:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144238464 00000100:00100000:0.0:1784938310.356344:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144238464 00000100:00100000:0.0:1784938310.356401:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 185 00000100:00100000:0.0:1784938310.356411:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1871643144238464:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784938310.356590:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1871643144238464:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 Request processed in 179us (375us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1784938310.356599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 185 00000100:00100000:3.0:1784938310.356824:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144238464:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784938310.356906:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1784938310.356952:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.356965:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.356974:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.356981:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938310.356986:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.356994:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.357013:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0800) 00010000:00010000:3.0:1784938310.357018:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784938310.357023:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.357031:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eea85 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938310.357151:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784938310.357250:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1784938310.357264:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378389049029ns, next at 379389046358ns, rc = 0 00000001:00080000:3.0:1784938310.357270:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1784938310.357295:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0800) 00010000:00010000:3.0:1784938310.357298:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784938310.357310:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eea70 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2879e expref: 50 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938310.357411:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+49:11373:x1871643125278464:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 22593us (24515us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1784938310.357419:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000020:00080000:3.0:1784938310.357424:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784938310.359735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00080000:1.0:1784938310.359873:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938310.362424:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125278720 00000100:00100000:0.0:1784938310.362446:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125278720 00000100:00100000:1.0:1784938310.367714:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 111 00000100:00100000:1.0:1784938310.367735:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+49:11373:x1871643125278720:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938310.367845:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938310.367880:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59eea8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287a5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.368666:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59eea8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287a5 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.368687:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59eea8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287a5 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.368738:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.368742:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938310.368747:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b200, rc 0) 00000100:00100000:1.0:1784938310.369155:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+50:11373:x1871643125278720:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1423us (9487us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.369164:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 111 00000100:00100000:0.0:1784938310.379420:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938310.379515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125278976 00000100:00100000:2.0:1784938310.379528:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125278976 00000100:00100000:2.0:1784938310.379612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:2.0:1784938310.379623:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+50:11373:x1871643125278976:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1784938310.379989:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+51:11373:x1871643125278976:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 366us (580us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1784938310.379997:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:3.0:1784938310.470903:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.471264:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125279104 00000100:00100000:1.0:1784938310.471279:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125279104 00000100:00100000:1.0:1784938310.471366:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00100000:1.0:1784938310.471507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+51:11383:x1871643125279104:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1784938310.471741:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.471764:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.471780:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.471793:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.471801:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.471807:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.471898:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.471924:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.471931:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938310.471995:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472010:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472016:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472023:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472030:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938310.472035:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472044:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472058:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938310.472061:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938310.472066:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472072:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eea93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472097:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472103:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472108:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472113:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938310.472116:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472122:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472130:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc73b3500) 00010000:00010000:1.0:1784938310.472132:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938310.472136:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472142:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eea9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472153:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472159:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472164:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472175:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938310.472178:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472184:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472191:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.472193:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938310.472196:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.472201:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.472471:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+51:11383:x1871643125279104:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 1093us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.472482:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00100000:0.0:1784938310.508900:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938310.509082:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125279360 00000100:00100000:2.0:1784938310.509095:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125279360 00000100:00100000:2.0:1784938310.509180:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:2.0:1784938310.509192:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+51:11386:x1871643125279360:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938310.510028:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938310.510063:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eeaa8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287ac expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.510166:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.510186:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.510201:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.510240:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.510249:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.510256:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.510400:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.510439:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.510447:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938310.510461:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784938310.511459:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511476:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511484:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511501:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938310.511506:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511515:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511532:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:2.0:1784938310.511536:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938310.511543:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511751:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeaaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511772:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511799:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511806:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511811:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938310.511815:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511822:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511832:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc73b3500) 00010000:00010000:2.0:1784938310.511835:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938310.511839:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511845:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eeab6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511910:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eeaa8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ac expref: 54 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511928:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ac expref: 53 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938310.511936:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:2.0:1784938310.511939:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938310.511948:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1e00, rc 0) 00000100:00100000:2.0:1784938310.512057:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+53:11386:x1871643125279360:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 2865us (3170us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1784938310.512067:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:3.0:1784938310.515985:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.516088:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125279488 00000100:00100000:1.0:1784938310.516101:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125279488 00000100:00100000:1.0:1784938310.516184:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:1.0:1784938310.516197:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+53:11386:x1871643125279488:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1784938310.516329:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.516350:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.516364:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.516665:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.517305:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.517314:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.517321:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938310.517327:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.517337:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.517353:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.517357:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938310.517362:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.517369:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeacb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.519293:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+53:11386:x1871643125279488:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 3084us (3309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.519308:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:2.0:1784938310.522397:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.523265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125279744 00000100:00100000:1.0:1784938310.523283:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125279744 00000100:00100000:1.0:1784938310.523383:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:1.0:1784938310.523414:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+53:11386:x1871643125279744:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938310.525552:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:11386:x1871643125279744:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 2111us (3149us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1784938310.525570:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:0.0:1784938310.593800:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.593975:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125280000 00000100:00100000:1.0:1784938310.593988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125280000 00000100:00100000:1.0:1784938310.594071:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:1.0:1784938310.594085:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:11396:x1871643125280000:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938310.594118:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938310.594122:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784938310.594156:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eea4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28790 expref: 54 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.594181:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938310.594187:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938310.594203:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eead2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.594412:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.594429:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ac expref: 54 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.594438:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.594478:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ac expref: 54 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.594509:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ac expref: 54 pid: 9526 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.594526:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2074000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144238592:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938310.594662:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd393300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938310.597683:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2074000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144238592:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938310.597724:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938310.598854:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938310.599082:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125280128 00000100:00100000:3.0:1784938310.599094:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125280128 00010000:00010000:3.0:1784938310.599148:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ac expref: 55 pid: 9526 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938310.599261:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:3.0:1784938310.599275:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+55:2393:x1871643125280128:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938310.599298:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938310.599306:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ac expref: 55 pid: 9526 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.599322:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ac expref: 55 pid: 9526 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.599351:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeabd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ac expref: 55 pid: 9526 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.599387:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:3.0:1784938310.599415:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.599426:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.599434:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.599463:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938310.599643:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.599655:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938310.599689:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:3.0:1784938310.599703:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:2393:x1871643125280128:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 429us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938310.599713:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00010000:00010000:1.0:1784938310.599877:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eead2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287b3 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.599902:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287b3 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.599913:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.599916:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784938310.599919:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b600, rc 0) 00000100:00100000:1.0:1784938310.599954:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:11396:x1871643125280000:12345-192.168.203.26@tcp:101:bash.0 Request processed in 5873us (6171us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1784938310.599972:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:2.0:1784938310.606444:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938310.606602:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125280256 00000100:00100000:3.0:1784938310.606613:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125280256 00000100:00100000:3.0:1784938310.606688:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:3.0:1784938310.606699:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:11396:x1871643125280256:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1784938310.606731:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938310.606766:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeae7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287ba expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.606812:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.606829:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.606844:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.606999:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeae7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ba expref: 56 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.607029:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ba expref: 55 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.607040:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:3.0:1784938310.607044:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784938310.607048:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0800, rc 0) 00000100:00100000:3.0:1784938310.607266:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+55:11396:x1871643125280256:12345-192.168.203.26@tcp:101:bash.0 Request processed in 569us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938310.607274:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:2.0:1784938310.612993:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.613357:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125280512 00000100:00100000:1.0:1784938310.613441:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125280512 00000100:00100000:1.0:1784938310.613574:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 117 00000100:00100000:1.0:1784938310.613588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+55:11396:x1871643125280512:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:1.0:1784938310.614067:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.614262:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.614280:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938310.614337:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1784938310.614500:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b087afa reply state 000000008f9c86bf transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.614516:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.614524:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.614527:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938310.614531:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938310.614916:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+58:11396:x1871643125280512:12345-192.168.203.26@tcp:36:bash.0 Request processed in 1328us (1934us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1784938310.614926:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 117 00000020:00080000:1.0:1784938310.614934:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784938310.618539:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.618658:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125280640 00000100:00100000:1.0:1784938310.618851:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125280640 00000100:00100000:1.0:1784938310.618973:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:1.0:1784938310.618986:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+58:11396:x1871643125280640:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938310.619018:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938310.619045:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eeafc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.619358:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.619389:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287b3 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.619400:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.619450:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287b3 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.619468:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287b3 expref: 59 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.619488:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2074000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144238720:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938310.619616:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd393300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938310.628275:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2074000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144238720:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938310.628323:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938310.628484:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.628785:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125280768 00000100:00100000:1.0:1784938310.628820:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125280768 00010000:00010000:1.0:1784938310.628872:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287b3 expref: 60 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.628930:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:1.0:1784938310.628943:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:2392:x1871643125280768:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938310.628969:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938310.628978:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287b3 expref: 60 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.628995:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287b3 expref: 60 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.629023:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eead9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287b3 expref: 60 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.629044:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.629050:0:9518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.629060:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.629069:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.629113:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938310.629190:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+59:2392:x1871643125280768:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 250us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.629211:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00010000:00010000:0.0:1784938310.629579:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.629588:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938310.629661:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784938310.629667:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938310.629704:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.629763:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eeafc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c1 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.629811:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c1 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.629822:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:0.0:1784938310.629825:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938310.629829:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b800, rc 0) 00000100:00100000:0.0:1784938310.629886:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+58:11396:x1871643125280640:12345-192.168.203.26@tcp:101:bash.0 Request processed in 10902us (11362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938310.629897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:2.0:1784938310.637650:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938310.638073:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125281024 00000100:00100000:3.0:1784938310.638095:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125281024 00000100:00100000:3.0:1784938310.638172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:3.0:1784938310.638184:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+58:11396:x1871643125281024:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:3.0:1784938310.639335:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+59:11396:x1871643125281024:12345-192.168.203.26@tcp:35:bash.0 Request processed in 1142us (1688us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1784938310.639350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:2.0:1784938310.711925:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.712061:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125281152 00000100:00100000:1.0:1784938310.712074:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125281152 00000100:00100000:1.0:1784938310.712158:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:1.0:1784938310.712183:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+59:11402:x1871643125281152:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938310.712277:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938310.712307:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eeb0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287c8 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.712424:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eeb11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.712443:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eeb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.712464:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eeb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938310.712525:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784938310.712531:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938310.712565:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eeb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.712598:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59eeb0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c8 expref: 61 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.712623:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eeb11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c8 expref: 60 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.712660:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938310.712664:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938310.712668:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215bc00, rc 0) 00000100:00100000:1.0:1784938310.712740:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:11402:x1871643125281152:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 560us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.712749:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:2.0:1784938310.718685:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.718755:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125281280 00000100:00100000:1.0:1784938310.718778:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125281280 00000100:00100000:1.0:1784938310.718856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:1.0:1784938310.718878:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:11402:x1871643125281280:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938310.718907:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938310.718937:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59eeb18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287cf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719019:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719038:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719053:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719065:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719073:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719105:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719238:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719249:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719257:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938310.719313:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784938310.719758:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938310.719800:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719815:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719824:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719831:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719838:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719844:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938310.719849:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719869:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719885:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938310.719888:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938310.719893:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719899:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeb1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719917:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719922:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719927:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719932:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938310.719934:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719939:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719945:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc73b3500) 00010000:00010000:1.0:1784938310.719948:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938310.719950:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.719964:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.720000:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1600/0x26783cd1c59eeb18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.720017:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.720025:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.720027:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938310.720030:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1e00, rc 0) 00000100:00100000:1.0:1784938310.721620:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+61:11402:x1871643125281280:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 2737us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.721637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:2.0:1784938310.732653:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938310.732895:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125281536 00000100:00100000:0.0:1784938310.732909:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125281536 00000100:00100000:0.0:1784938310.732998:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:0.0:1784938310.733011:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+61:11402:x1871643125281536:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938310.733038:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938310.733067:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eeb34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.733255:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.733274:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c1 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.733283:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.733315:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.733373:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.733390:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 62 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938310.733406:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7769500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144238848:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938310.733723:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c1 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.733734:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c1 expref: 62 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938310.733748:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144238976:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938310.733787:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938310.736359:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.736536:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125281664 00000100:00100000:1.0:1784938310.736558:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125281664 00010000:00010000:1.0:1784938310.736612:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 63 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.736669:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:1.0:1784938310.736680:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:2393:x1871643125281664:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938310.736699:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938310.736706:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 63 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.736743:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 63 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.736772:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.736779:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.736789:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.736796:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938310.736861:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:2393:x1871643125281664:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 183us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.736870:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00010000:00010000:3.0:1784938310.737319:0:6512:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.26@tcp) returned -22 from blocking AST (req@00000000583ea6fa x1871643144238848) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 62 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.737335:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eeb2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287cf expref: 62 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938310.737355:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7769500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144238848:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938310.737371:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7768380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144238976:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938310.737405:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:3.0:1784938310.737409:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.737473:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.737486:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938310.739247:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938310.739560:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125281792 00000100:00100000:3.0:1784938310.739572:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125281792 00010000:00010000:3.0:1784938310.739627:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c1 expref: 62 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938310.739697:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:3.0:1784938310.739709:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+62:2392:x1871643125281792:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938310.739835:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938310.739845:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c1 expref: 62 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.739862:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c1 expref: 62 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.739888:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59eeb03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c1 expref: 62 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.739907:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:3.0:1784938310.739931:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.739943:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.739953:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.739995:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938310.740067:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+61:2392:x1871643125281792:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 360us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938310.740076:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00010000:00010000:0.0:1784938310.740333:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.740343:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938310.740366:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784938310.740563:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eeb34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287d6 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.740600:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287d6 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.740608:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:0.0:1784938310.740612:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784938310.740614:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77e00, rc 0) 00000100:00100000:0.0:1784938310.740651:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+61:11402:x1871643125281536:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 7644us (8016us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1784938310.740659:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:2.0:1784938310.751499:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.751847:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125282048 00000100:00100000:1.0:1784938310.751860:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125282048 00000100:00100000:1.0:1784938310.751949:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:1.0:1784938310.751961:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+61:11402:x1871643125282048:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:1.0:1784938310.751982:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938310.752015:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59eea8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287a5 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.752041:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.752048:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938310.752132:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:11402:x1871643125282048:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 172us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.752163:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:2.0:1784938310.758192:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938310.760420:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125282176 00000100:00100000:0.0:1784938310.760442:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125282176 00000100:00100000:1.0:1784938310.763286:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:1.0:1784938310.763306:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:11402:x1871643125282176:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:1.0:1784938310.763511:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.763534:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.763558:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938310.763817:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1784938310.764322:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:11402:x1871643125282176:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 1016us (6140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.764334:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:2.0:1784938310.767333:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938310.769708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125282304 00000100:00100000:1.0:1784938310.769835:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125282304 00000100:00100000:1.0:1784938310.770002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:1.0:1784938310.770015:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:11402:x1871643125282304:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938310.770046:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938310.770086:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.770178:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.770192:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287dd expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.770272:0:6514:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.770289:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287dd expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.770305:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938310.770309:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938310.770313:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287dd expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.770322:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d0a00, rc 0) 00000100:00100000:1.0:1784938310.770413:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+61:11402:x1871643125282304:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 400us (3198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.770421:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 123 00010000:00010000:0.0:1784938311.268912:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938311.775504:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938311.775520:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938311.775597:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1784938311.775612:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784938311.775791:0:13794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2074000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144239104:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784938311.775932:0:13794:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd393300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938311.784905:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938311.785135:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125282432 00000100:00100000:3.0:1784938311.785144:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125282432 00000100:00100000:3.0:1784938311.785293:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:3.0:1784938311.785305:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+62:11404:x1871643125282432:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784938311.785340:0:6512:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784938311.785455:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+62:11404:x1871643125282432:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 153us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938311.785463:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00080000:2.0:1784938311.785653:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938311.789348:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938311.789546:0:13794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2074000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144239104:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784938311.789689:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125282560 00000100:00100000:3.0:1784938311.789696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125282560 00000100:00100000:3.0:1784938311.789749:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:3.0:1784938311.789759:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+61:11404:x1871643125282560:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784938311.789823:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.789841:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.789866:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.789882:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.789890:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.789897:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.789917:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.789926:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.789933:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938311.789972:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784938311.789976:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938311.789987:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.789997:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790005:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790021:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790027:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938311.790032:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790039:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790050:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:3.0:1784938311.790053:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938311.790057:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790063:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eeb57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790074:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790079:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790085:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790090:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938311.790093:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790109:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790117:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff910cc2a19100) 00010000:00010000:3.0:1784938311.790120:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938311.790123:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790128:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790144:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790152:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790158:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790163:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938311.790166:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790172:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790179:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:3.0:1784938311.790181:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938311.790184:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.790210:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938311.790330:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+61:11404:x1871643125282560:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 571us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938311.790338:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:2.0:1784938311.795435:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938311.795523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125282816 00000100:00100000:1.0:1784938311.795532:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125282816 00000100:00100000:1.0:1784938311.795601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:1.0:1784938311.795612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+61:11404:x1871643125282816:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938311.795648:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938311.795669:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eeb6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795771:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795787:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795800:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938311.795811:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784938311.795886:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795893:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795900:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795907:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938311.795911:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795919:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795930:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938311.795938:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784938311.795943:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795950:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795990:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eeb6c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287e4 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.795999:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:1.0:1784938311.796002:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938311.796006:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eeb6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287e4 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.796016:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1600, rc 0) 00000100:00100000:1.0:1784938311.796073:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+62:11404:x1871643125282816:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 464us (648us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1784938311.796080:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:1.0:1784938311.809606:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938311.809770:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125282944 00000100:00100000:0.0:1784938311.809780:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125282944 00000100:00100000:0.0:1784938311.809874:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:0.0:1784938311.809884:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+62:11404:x1871643125282944:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784938311.809920:0:9526:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784938311.810038:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+62:11404:x1871643125282944:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 155us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938311.810045:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:2.0:1784938311.818152:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938311.818265:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125283200 00000100:00100000:1.0:1784938311.818275:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125283200 00000100:00100000:1.0:1784938311.818334:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:1.0:1784938311.818345:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+62:11404:x1871643125283200:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938311.818364:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938311.818367:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784938311.818391:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59eeb11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287c8 expref: 62 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.818429:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938311.818434:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938311.818462:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eeb81 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287eb expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938311.818840:0:13805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1784938311.818968:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.818981:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.818991:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.819040:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eeb81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287eb expref: 64 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.819056:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287eb expref: 63 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.819064:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc66c0700) 00010000:00010000:1.0:1784938311.819066:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938311.819069:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1000, rc 0) 00000100:00100000:1.0:1784938311.819125:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:11404:x1871643125283200:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 782us (980us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1784938311.819133:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:2.0:1784938311.825651:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938311.825845:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125283456 00000100:00100000:3.0:1784938311.825858:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125283456 00000100:00100000:3.0:1784938311.825938:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:3.0:1784938311.825950:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:11404:x1871643125283456:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784938311.826041:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938311.826076:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eeb88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287eb expref: 63 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826102:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc66c0700) 00010000:00010000:3.0:1784938311.826119:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938311.826146:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826162:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826172:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826383:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826407:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826434:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826490:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826498:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826505:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826511:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938311.826516:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826524:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826545:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:3.0:1784938311.826548:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938311.826552:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826558:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eeb96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826572:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826578:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826590:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826595:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938311.826599:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826606:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826613:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb5879991 (ffff910cc2a19100) 00010000:00010000:3.0:1784938311.826615:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938311.826618:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.826624:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeb9d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb5879991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938311.826733:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+62:11404:x1871643125283456:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 781us (1103us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938311.826743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:0.0:1784938311.829658:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938311.829775:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125283584 00000100:00100000:2.0:1784938311.829785:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125283584 00000100:00100000:2.0:1784938311.829862:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:2.0:1784938311.829872:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+62:11404:x1871643125283584:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938311.829895:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938311.829919:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eeba4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287f2 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.829975:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.829989:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.830012:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.830127:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eeba4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f2 expref: 64 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.830147:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f2 expref: 63 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.830158:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:2.0:1784938311.830161:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938311.830164:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0e00, rc 0) 00000100:00100000:2.0:1784938311.830264:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:11404:x1871643125283584:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 392us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938311.830271:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:2.0:1784938311.836000:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938311.836098:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125283840 00000100:00100000:3.0:1784938311.836117:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125283840 00000100:00100000:3.0:1784938311.836247:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:3.0:1784938311.836261:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:11404:x1871643125283840:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784938311.836380:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.836403:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.836437:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938311.836688:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1784938311.836701:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379868485800ns, next at 380868482740ns, rc = 0 00000004:00010000:3.0:1784938311.836768:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001081d155 reply state 00000000319d9ac2 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.836784:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.836792:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:3.0:1784938311.836795:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784938311.836800:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938311.836942:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:11404:x1871643125283840:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 682us (959us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1784938311.836951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:2.0:1784938311.839647:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144239232:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938311.842229:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938311.842851:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125283968 00000100:00100000:3.0:1784938311.842871:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125283968 00000100:00100000:3.0:1784938311.842962:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:3.0:1784938311.842978:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:11404:x1871643125283968:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938311.843015:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938311.843043:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a287f9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.843122:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f9 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.843164:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f9 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.843190:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:3.0:1784938311.843193:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938311.843198:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1000, rc 0) 00000100:00100000:3.0:1784938311.843320:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:11404:x1871643125283968:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 345us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938311.843330:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:0.0:1784938311.844352:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938311.845486:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144239232 00000100:00100000:3.0:1784938311.845503:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144239232 00000100:00100000:3.0:1784938311.845613:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 186 00000100:00100000:3.0:1784938311.845743:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144239232:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938311.845797:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784938311.848683:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144239232:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 3040us (4317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938311.848704:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 186 00000100:00100000:1.0:1784938311.854986:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938311.855668:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144239232:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938311.855953:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125284096 00000100:00100000:3.0:1784938311.855963:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125284096 00000100:00100000:3.0:1784938311.856097:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:3.0:1784938311.856124:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2393:x1871643125284096:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1784938311.856495:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125284096:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 387us (1524us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1784938311.856504:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00080000:1.0:1784938311.856571:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938311.865019:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938311.868794:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125284352 00000100:00100000:3.0:1784938311.868816:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125284352 00000100:00100000:3.0:1784938311.868914:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:3.0:1784938311.868926:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:11404:x1871643125284352:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784938311.869406:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:11404:x1871643125284352:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 478us (4399us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1784938311.869415:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:0.0:1784938311.877944:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938311.883824:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125284608 00000100:00100000:1.0:1784938311.883847:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125284608 00000100:00100000:1.0:1784938311.884022:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:1.0:1784938311.884036:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:11404:x1871643125284608:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784938311.884210:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:11404:x1871643125284608:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 176us (6283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938311.884237:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:2.0:1784938311.895915:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938311.896044:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125284736 00000100:00100000:3.0:1784938311.896058:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125284736 00000100:00100000:3.0:1784938311.896138:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:3.0:1784938311.896199:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:11404:x1871643125284736:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938311.896246:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938311.896274:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eebc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28800 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.896368:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eebc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.896386:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.896399:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938311.896458:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938311.896481:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eebc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.896512:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eebc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28800 expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.896560:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eebc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28800 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.896571:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:3.0:1784938311.896574:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784938311.896579:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0400, rc 0) 00000100:00100000:3.0:1784938311.896654:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:11404:x1871643125284736:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 458us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938311.905865:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938311.905967:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125284864 00000100:00100000:0.0:1784938311.905998:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125284864 00000100:00100000:0.0:1784938311.906075:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:0.0:1784938311.906088:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2394:x1871643125284864:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938311.906113:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938311.906142:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28807 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938311.906173:0:8770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63ff47, blocks: 0x0 00010000:00010000:0.0:1784938311.906201:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1784938311.906207:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938311.906240:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28807 expref: 10 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.906261:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28807 expref: 10 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.906280:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76c00, rc 0) 00000100:00100000:0.0:1784938311.906360:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:2394:x1871643125284864:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 274us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938311.906369:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:3.0:1784938311.911298:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:0.0:1784938311.914429:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938311.914923:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125285120 00000100:00100000:2.0:1784938311.914936:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125285120 00000100:00100000:2.0:1784938311.915017:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:2.0:1784938311.915028:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:11404:x1871643125285120:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784938311.915179:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:11404:x1871643125285120:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 152us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938311.915187:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:2.0:1784938311.921669:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938311.921786:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125285248 00000100:00100000:3.0:1784938311.921798:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125285248 00000100:00100000:3.0:1784938311.921878:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1784938311.921890:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:11404:x1871643125285248:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938311.921915:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938311.921940:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2880e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.921980:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28807 expref: 11 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.921990:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938311.921995:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938311.922001:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.922067:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28807 expref: 11 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.922083:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28807 expref: 11 pid: 8770 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938311.922099:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1871643144239360:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938311.922269:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938311.927452:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938311.927636:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1871643144239360:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938311.927683:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.927712:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1600, rc 0) 00000100:00100000:0.0:1784938311.927879:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:11404:x1871643125285248:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 5989us (6223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938311.927887:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125285376 00000100:00100000:0.0:1784938311.927891:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:2.0:1784938311.927897:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125285376 00010000:00010000:2.0:1784938311.927944:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28807 expref: 11 pid: 8770 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938311.927987:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:2.0:1784938311.927996:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:2392:x1871643125285376:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938311.928014:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938311.928042:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28807 expref: 11 pid: 8770 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.928056:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28807 expref: 11 pid: 8770 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.928084:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59eebce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28807 expref: 11 pid: 8770 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.928103:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938311.928128:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938311.928138:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.928150:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.928195:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938311.928211:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1871643144239488:192.168.203.26@tcp:105: 00000100:00100000:2.0:1784938311.928496:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7335840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938311.934031:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1871643144239488:192.168.203.26@tcp:105: 00010000:00010000:2.0:1784938311.934069:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938311.934153:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:2392:x1871643125285376:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 6156us (6713us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938311.934166:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:1.0:1784938311.934773:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938311.938457:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125285504 00000100:00100000:0.0:1784938311.938479:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125285504 00002000:00100000:0.0:1784938311.938592:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff910cd2077480 x1871643125285504/t0(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:542/0 lens 504/0 e 0 to 0 dl 1784938322 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938311.938607:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cd2077480 with x1871643125285504 ext(0->12) 00002000:00010000:0.0:1784938311.938613:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910cd2077480 00000100:00100000:0.0:1784938311.938647:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:0.0:1784938311.938659:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:2393:x1871643125285504:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784938311.940088:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:2393:x1871643125285504:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 1416us (5303us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784938311.940103:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00002000:00100000:0.0:1784938311.940115:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff910cd2077480 x1871643125285504/t4294967309(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:542/0 lens 504/448 e 0 to 0 dl 1784938322 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938311.940126:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cd2077480 with x1871643125285504 ext(0->12) 00002000:00010000:0.0:1784938311.940133:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910cd2077480 00000100:00100000:1.0:1784938311.957321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938311.960782:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125285632 00000100:00100000:2.0:1784938311.960804:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125285632 00000100:00100000:2.0:1784938311.960911:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:2.0:1784938311.960924:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:11404:x1871643125285632:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784938311.967126:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1784938311.967157:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1784938311.967243:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1784938311.967276:0:6492:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910bc66edb40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1784938311.967281:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cfd706f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910bc66ed300 00000020:00080000:2.0:1784938311.967301:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cfd706a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910bc7e09c00 00000004:00080000:2.0:1784938311.967339:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1784938311.967366:0:6492:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910cc99590c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1784938311.967370:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cc9044400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910cc99599c0 00000020:00080000:2.0:1784938311.967373:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cc9044800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910cca3f3800 00000020:00080000:2.0:1784938311.967403:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1784938311.967488:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1784938311.968146:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144239616:192.168.203.126@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938311.968287:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938311.968295:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144239744:192.168.203.126@tcp:2:osp-syn-1-0.0 00000100:00100000:1.0:1784938311.968339:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938311.968350:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144239872:192.168.203.126@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938311.968591:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938311.968912:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938311.968948:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938311.968978:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144239616 00000100:00100000:1.0:1784938311.968986:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144239616 00000100:00100000:1.0:1784938311.969054:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144239744 00000100:00100000:1.0:1784938311.969058:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144239744 00000100:00100000:1.0:1784938311.969088:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144239872 00000100:00100000:1.0:1784938311.969091:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144239872 00000100:00100000:1.0:1784938311.969110:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:1.0:1784938311.969120:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1871643144239616:12345-192.168.203.126@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938311.969161:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1784938311.969196:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.969246:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28766 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.969257:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1784938311.969262:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938311.969267:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.969306:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28766 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.969323:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28766 expref: 11 pid: 8429 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938311.969338:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1871643144240000:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938311.969402:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd498480 going to sleep for 11 seconds 00000100:00080000:1.0:1784938311.969418:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938311.969921:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:1.0:1784938311.969934:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1871643144239744:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 00002000:00010000:1.0:1784938311.970101:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784938311.970105:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784938311 00002000:00010000:1.0:1784938311.970108:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784938311.970110:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1784938311 -> 1784938311 00002000:00010000:1.0:1784938311.970113:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1784938311.970161:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3640:x1871643144239744:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 Request processed in 231us (1249us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784938311.970170:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:1.0:1784938311.970197:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:1.0:1784938311.970205:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1871643144239872:12345-192.168.203.126@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938311.970248:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1784938311.970278:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a63ff45, atime: 0x6a63ff46, ctime: 0x6a63ff45, blocks: 0x8 00010000:00010000:1.0:1784938311.970285:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970299:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1784938311.970303:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938311.970310:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970331:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970343:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970363:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970386:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938311.970502:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1871643144239872:12345-192.168.203.126@tcp:6:osp-syn-0-0.0 Request processed in 298us (1552us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784938311.970510:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 50 00010000:00010000:1.0:1784938311.970531:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938311.970556:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970564:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938311.970569:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970580:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970599:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970607:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000105c3f89/0x26783cd1c59eebe3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938311.970631:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938311.970642:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938311.970644:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938311.971033:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11404:x1871643125285632:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 10108us (13722us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938311.971044:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000004:00080000:1.0:1784938311.979861:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910cffb54380/2, rc 0, transno 4294967310 00000100:00100000:1.0:1784938311.979885:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144239744:192.168.203.126@tcp:2:osp-syn-1-0.0 00000004:00080000:2.0:1784938311.980022:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910cd2077b80/2, rc 0, transno 4294967305 00000100:00100000:2.0:1784938311.980030:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144239872:192.168.203.126@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938311.980122:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980137:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980146:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980154:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938311.980160:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980169:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980238:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff910cfcf9cc00) 00010000:00010000:0.0:1784938311.980242:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938311.980249:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980257:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ee8da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980293:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980301:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980307:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980313:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938311.980316:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980323:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980331:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff910cc2a19b00) 00010000:00010000:0.0:1784938311.980334:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938311.980338:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980343:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ee982 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980378:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980385:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980392:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980397:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938311.980401:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980407:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980416:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc73b3500) 00010000:00010000:0.0:1784938311.980418:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938311.980422:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980428:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59eea00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980440:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980447:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980453:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980465:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938311.980468:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980475:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980484:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc73b3500) 00010000:00010000:0.0:1784938311.980486:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938311.980489:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980495:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59eea23 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980515:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980521:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980528:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980533:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938311.980718:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980726:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980746:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:0.0:1784938311.980749:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938311.980752:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980758:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59eeaf5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980772:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980778:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980783:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980788:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938311.980791:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980797:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980804:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:0.0:1784938311.980807:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784938311.980810:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.980815:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eebb2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938311.981345:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938311.981443:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938311.981520:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125285888 00000100:00100000:2.0:1784938311.981531:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125285888 00000100:00100000:2.0:1784938311.981618:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:2.0:1784938311.981631:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:2395:x1871643125285888:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784938311.983165:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125285760 00000100:00100000:3.0:1784938311.983185:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125285760 00010000:00010000:3.0:1784938311.983279:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28766 expref: 13 pid: 8429 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938311.983335:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:3.0:1784938311.983346:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:2392:x1871643125285760:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938311.983365:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938311.983372:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28766 expref: 13 pid: 8429 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.983408:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28766 expref: 13 pid: 8429 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.983441:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1784938311.983446:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1784938311.983454:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.983465:0:7921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938311.983495:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938311.983581:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:2392:x1871643125285760:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 237us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938311.983590:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75 00010000:00010000:0.0:1784938311.984940:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063425cb8/0x26783cd1c59ee990 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28766 expref: 12 pid: 8429 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938311.984970:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1871643144240000:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938311.985006:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.985020:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.985028:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.985039:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.985048:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938311.985293:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938311.985513:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3640:x1871643144239616:12345-192.168.203.126@tcp:6:osp-syn-1-0.0 Request processed in 16392us (16921us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784938311.985526:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 48 00000001:00080000:1.0:1784938311.985828:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1784938311.985840:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000004:00080000:1.0:1784938311.986108:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910cffb54000/2, rc 0, transno 4294967311 00000100:00100000:1.0:1784938311.986117:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144239616:192.168.203.126@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938311.986278:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125285888:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 4648us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938311.986287:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00010000:00010000:2.0:1784938311.989107:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938311.989124:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.989140:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938311.989146:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.989158:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938311.989805:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:2.0:1784938311.990261:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.990272:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a67bc3ef/0x26783cd1c59eebdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.990303:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938311.990305:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938311.990307:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938311.990385:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125286144 00000100:00100000:3.0:1784938311.990400:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125286144 00000100:00100000:2.0:1784938311.993819:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:2.0:1784938311.993850:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:11404:x1871643125286144:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784938311.993912:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938311.993940:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eebc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28800 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.993960:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:2.0:1784938311.993965:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938311.993993:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.994006:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.994016:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938311.994128:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007328e967 reply state 0000000043723ffe transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.994153:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938311.994159:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:2.0:1784938311.994284:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938311.994288:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938311.994484:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:11404:x1871643125286144:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 650us (4690us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1784938311.994492:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:1.0:1784938311.998027:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938311.999897:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125286272 00000100:00100000:3.0:1784938311.999920:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125286272 00000100:00100000:2.0:1784938312.000170:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:2.0:1784938312.000184:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2393:x1871643125286272:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784938312.000450:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784938312.000455:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1784938311 -> 1784938310 00002000:00010000:2.0:1784938312.000457:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784938310 00002000:00010000:2.0:1784938312.000459:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1784938311 -> 1784938310 00002000:00010000:2.0:1784938312.000462:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1784938312.000564:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2393:x1871643125286272:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 382us (2550us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1784938312.000572:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1784938312.005137:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938312.005316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125286528 00000100:00100000:0.0:1784938312.005329:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125286528 00000100:00100000:0.0:1784938312.005425:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:0.0:1784938312.005436:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:11404:x1871643125286528:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784938312.005547:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.005569:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f2 expref: 17 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.005581:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.005633:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f2 expref: 17 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.005650:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f2 expref: 17 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938312.005681:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144240128:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938312.005798:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938312.017119:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938312.018253:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125286656 00000100:00100000:2.0:1784938312.018270:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125286656 00010000:00010000:2.0:1784938312.018335:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f2 expref: 18 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938312.018383:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:2.0:1784938312.018394:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:2393:x1871643125286656:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938312.018434:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938312.018443:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f2 expref: 18 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.018458:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f2 expref: 18 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.018486:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:2.0:1784938312.018491:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.018502:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.018511:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.018599:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938312.018852:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:2393:x1871643125286656:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 457us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938312.018860:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 76 00010000:00010000:0.0:1784938312.022976:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eebab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f2 expref: 17 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938312.023014:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144240128:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938312.023051:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.023065:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.023100:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.023158:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.023167:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.023175:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.023182:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938312.023187:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.023197:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.023283:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:0.0:1784938312.023287:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784938312.023294:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.023301:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eebf1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938312.023425:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:11404:x1871643125286528:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 17989us (18308us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784938312.023437:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:3.0:1784938312.026210:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938312.026410:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125286784 00000100:00100000:0.0:1784938312.026422:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125286784 00000100:00100000:0.0:1784938312.026485:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:0.0:1784938312.026496:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2395:x1871643125286784:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784938312.026573:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.026600:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.026611:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784938312.026620:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938312.026625:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.026681:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.026699:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 7 pid: 8430 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938312.026715:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1871643144240256:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938312.027168:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938312.031493:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938312.031927:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125286912 00000100:00100000:3.0:1784938312.031939:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125286912 00010000:00010000:3.0:1784938312.032006:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 8 pid: 8430 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938312.032061:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:3.0:1784938312.032071:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2393:x1871643125286912:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938312.032090:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938312.032118:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 8 pid: 8430 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.032134:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 8 pid: 8430 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.032166:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938312.032171:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938312.032178:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.032190:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.032239:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938312.032511:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2393:x1871643125286912:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 439us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938312.032520:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 77 00010000:00010000:0.0:1784938312.032867:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59eebd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2880e expref: 7 pid: 8430 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938312.032886:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1871643144240256:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938312.032927:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.032940:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.032948:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.032973:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.032983:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.032991:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.033000:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938312.033278:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.033291:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.033306:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.033321:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59eebf8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938312.033467:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125286784:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 6971us (7271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938312.033478:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1784938312.036792:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938312.036977:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125287168 00000100:00100000:0.0:1784938312.036990:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125287168 00000100:00100000:0.0:1784938312.037096:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:0.0:1784938312.037108:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:11404:x1871643125287168:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784938312.037246:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.037268:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ba expref: 16 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.037280:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.037325:0:13805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ba expref: 16 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.037341:0:13805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ba expref: 16 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938312.037359:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144240384:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938312.037470:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938312.041429:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144240384:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938312.041473:0:13805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938312.041790:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938312.042207:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125287296 00000100:00100000:3.0:1784938312.042249:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125287296 00010000:00010000:3.0:1784938312.042301:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ba expref: 17 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938312.042346:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:3.0:1784938312.042358:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:2392:x1871643125287296:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938312.042377:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938312.042386:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ba expref: 17 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.042400:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ba expref: 17 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.042430:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eeaee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287ba expref: 17 pid: 9526 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.042451:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:3.0:1784938312.042458:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287dd expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.042470:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.042479:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.042502:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.042532:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938312.042836:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:2392:x1871643125287296:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 478us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938312.042846:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00010000:00010000:3.0:1784938312.042877:0:13805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.042886:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.043162:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.043176:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f9 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.043186:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.043251:0:13805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f9 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.043267:0:13805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f9 expref: 16 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938312.043284:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cca300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144240512:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938312.043360:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938312.046886:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938312.047056:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cca300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144240512:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938312.047092:0:13805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938312.047176:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125287424 00000100:00100000:2.0:1784938312.047184:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125287424 00010000:00010000:2.0:1784938312.047368:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f9 expref: 17 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938312.047447:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:2.0:1784938312.047458:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:2393:x1871643125287424:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938312.047477:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938312.047485:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f9 expref: 17 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.047498:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f9 expref: 17 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.047527:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eebb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287f9 expref: 17 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.047564:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:2.0:1784938312.047569:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.047579:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.047589:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.047625:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938312.047704:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:2393:x1871643125287424:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 247us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938312.047712:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 79 00010000:00010000:0.0:1784938312.047926:0:13805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938312.047935:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938312.048076:0:13805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1784938312.048209:0:13805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1784938312.048282:0:13805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1784938312.048390:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13805:1871643144240640:192.168.203.126@tcp:1000:mdt00_004.0 00000100:00100000:0.0:1784938312.048467:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc66ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938312.048677:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938312.049589:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144240640 00000100:00100000:0.0:1784938312.049603:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144240640 00000100:00100000:0.0:1784938312.049684:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 187 00000100:00100000:0.0:1784938312.049696:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13805:x1871643144240640:12345-192.168.203.126@tcp:1000:mdt00_004.0 00000100:00100000:0.0:1784938312.049820:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13805:x1871643144240640:12345-192.168.203.126@tcp:1000:mdt00_004.0 Request processed in 126us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938312.049829:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 187 00000100:00100000:1.0:1784938312.050149:0:13805:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1784938312.050158:0:13805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1784938312.050188:0:13805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910cffb54380, transno 4294967310 00000100:00100000:1.0:1784938312.050209:0:13805:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff910cffb54000 x1871643144239616/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 544/432 e 0 to 0 dl 1784938327 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938312.050260:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13805:1871643144240640:192.168.203.126@tcp:1000:mdt00_004.0 00000001:00080000:1.0:1784938312.050565:0:13805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1784938312.050636:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb54380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13805:1871643144240768:192.168.203.126@tcp:1000:mdt00_004.0 00000100:00100000:1.0:1784938312.050715:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc58f2900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938312.050825:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938312.052904:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144240768 00000100:00100000:3.0:1784938312.052926:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144240768 00000100:00100000:3.0:1784938312.053023:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 188 00000100:00100000:3.0:1784938312.053036:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13805:x1871643144240768:12345-192.168.203.126@tcp:1000:mdt00_004.0 00000100:00100000:3.0:1784938312.053295:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:13805:x1871643144240768:12345-192.168.203.126@tcp:1000:mdt00_004.0 Request processed in 260us (2468us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1784938312.053305:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 188 00000100:00100000:1.0:1784938312.053778:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb54380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13805:1871643144240768:192.168.203.126@tcp:1000:mdt00_004.0 00010000:00010000:1.0:1784938312.053867:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.053880:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.053889:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.053896:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938312.053902:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.053911:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.053931:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:1.0:1784938312.053935:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938312.053941:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.053948:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec06 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.053980:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.053987:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.053994:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.054010:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938312.054013:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.054020:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.054030:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938312.054032:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938312.054038:0:13805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287dd expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.054051:0:13805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287dd expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.054061:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287dd expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.054102:0:13805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287dd expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938312.054120:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144240896:192.168.203.26@tcp:105: 00000100:00100000:1.0:1784938312.054205:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc58f2900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938312.065822:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938312.065920:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125287552 00000100:00100000:3.0:1784938312.065934:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125287552 00000100:00100000:3.0:1784938312.066008:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:3.0:1784938312.066021:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11402:x1871643125287552:12345-192.168.203.26@tcp:49:lfs.0 00000100:00100000:3.0:1784938312.066194:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:11402:x1871643125287552:12345-192.168.203.26@tcp:49:lfs.0 Request processed in 176us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938312.066202:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:2.0:1784938312.066389:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144240896:192.168.203.26@tcp:105: 00010000:00010000:2.0:1784938312.066440:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066453:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eeb49 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066494:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066511:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066525:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066547:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066554:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066561:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066567:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938312.066572:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066579:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066594:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:2.0:1784938312.066597:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938312.066609:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066615:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eec0d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066628:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066635:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066640:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066645:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938312.066648:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066654:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066662:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:2.0:1784938312.066665:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938312.066668:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.066674:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eebff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938312.066861:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11404:x1871643125287168:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 29755us (30083us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1784938312.066870:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 139 00000020:00080000:2.0:1784938312.066882:0:13805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784938312.067302:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938312.067308:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938312.067824:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1784938312.067837:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784938312.081498:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938312.081575:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938312.081783:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125288064 00000100:00100000:2.0:1784938312.081795:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125288064 00000100:00100000:2.0:1784938312.081874:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:2.0:1784938312.081885:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11402:x1871643125288064:12345-192.168.203.26@tcp:58:lfs.0 00000040:00080000:2.0:1784938312.082133:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1784938312.082284:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11402:x1871643125288064:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 400us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938312.082292:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:3.0:1784938312.083200:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125287808 00000100:00100000:3.0:1784938312.083252:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125287808 00000100:00100000:3.0:1784938312.083314:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:3.0:1784938312.083325:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:11404:x1871643125287808:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784938312.083785:0:6516:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784938312.083827:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1784938312.083870:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.083892:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.083904:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.083913:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.083919:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.083926:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938312.084084:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938312.084205:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:11404:x1871643125287808:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 880us (2718us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1784938312.084240:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 32 00000020:00080000:3.0:1784938312.084247:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784938312.089022:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938312.089045:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.089059:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938312.089064:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.089076:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.089100:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:2.0:1784938312.089103:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938312.089109:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.089115:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec14 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.089136:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938312.089138:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938312.089140:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938312.130262:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938312.130380:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125288192 00000100:00100000:1.0:1784938312.130393:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125288192 00000100:00100000:1.0:1784938312.130470:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:1.0:1784938312.130481:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:11406:x1871643125288192:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938312.130549:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938312.130581:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eec1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28815 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.130840:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.130862:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.130876:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.130893:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.130900:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.130907:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.131007:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.131019:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287d6 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.131028:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.131071:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287d6 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.131097:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287d6 expref: 22 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938312.131114:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144241024:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938312.131301:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc58f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938312.138294:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144241024:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938312.138337:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938312.141457:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938312.141816:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125288448 00000100:00100000:1.0:1784938312.141829:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125288448 00000100:00100000:1.0:1784938312.141902:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:1.0:1784938312.141913:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:6163:x1871643125288448:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784938312.142204:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:6163:x1871643125288448:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 292us (763us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1784938312.142256:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:1.0:1784938312.154895:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938312.155015:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125288576 00000100:00100000:2.0:1784938312.155029:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125288576 00010000:00010000:2.0:1784938312.155090:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287d6 expref: 24 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938312.155146:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:2.0:1784938312.155157:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:2392:x1871643125288576:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938312.155177:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938312.155185:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287d6 expref: 24 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.155200:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287d6 expref: 24 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.155277:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eeb3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287d6 expref: 24 pid: 6512 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.155299:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:2.0:1784938312.155306:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.155317:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.155326:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938312.155358:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938312.155439:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:2392:x1871643125288576:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 283us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938312.155469:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00010000:00010000:1.0:1784938312.156129:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156142:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938312.156248:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784938312.156253:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938312.156283:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156299:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156327:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156334:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156342:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156349:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938312.156355:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156364:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156379:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:1.0:1784938312.156382:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938312.156386:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156393:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eec22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156408:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156415:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156421:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156435:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938312.156439:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156445:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156455:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff910bc66c0c00) 00010000:00010000:1.0:1784938312.156458:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938312.156460:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156467:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eec29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156519:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eec1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28815 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156559:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28815 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938312.156569:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938312.156571:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938312.156574:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1400, rc 0) 00000100:00100000:1.0:1784938312.156650:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11406:x1871643125288192:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 26169us (26451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938312.156659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 141 00010000:00010000:1.0:1784938312.287672:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784938313.119436:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938313.119452:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938313.119486:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784938313.119495:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784938313.119721:0:13794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cca300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144241152:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784938313.119890:0:13794:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938313.127455:0:13794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cca300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144241152:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784938313.130565:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938313.133182:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125288704 00000100:00100000:3.0:1784938313.133208:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125288704 00000100:00100000:3.0:1784938313.133885:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:3.0:1784938313.133900:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11418:x1871643125288704:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784938313.133950:0:13805:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784938313.134716:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11418:x1871643125288704:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 812us (4157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938313.134729:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00080000:1.0:1784938313.134828:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938313.148660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938313.148848:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125288960 00000100:00100000:3.0:1784938313.148862:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125288960 00000100:00100000:3.0:1784938313.148942:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:3.0:1784938313.148954:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:11418:x1871643125288960:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938313.148983:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938313.149010:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2881c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.149248:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.149268:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.149285:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938313.149298:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784938313.149447:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eec37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2881c expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.149485:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2881c expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.149495:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:3.0:1784938313.149499:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938313.149502:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1c00, rc 0) 00000100:00100000:3.0:1784938313.149603:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:11418:x1871643125288960:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 651us (958us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1784938313.149611:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:3.0:1784938313.154161:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938313.156860:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125289088 00000100:00100000:2.0:1784938313.156883:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125289088 00000100:00100000:2.0:1784938313.156978:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:2.0:1784938313.156990:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:2394:x1871643125289088:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938313.157009:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938313.157041:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eec3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2881c expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938313.157064:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:2.0:1784938313.157070:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938313.157162:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:2394:x1871643125289088:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 174us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938313.157171:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:1.0:1784938313.159937:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938313.162334:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125289344 00000100:00100000:0.0:1784938313.162355:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125289344 00000100:00100000:0.0:1784938313.162450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:0.0:1784938313.162464:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:11418:x1871643125289344:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784938313.163994:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938313.164025:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938313.164041:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938313.164361:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938313.164371:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938313.164379:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938313.164387:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938313.164392:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938313.164401:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938313.164417:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:0.0:1784938313.164421:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784938313.164427:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938313.164451:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eec4c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938313.165038:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:11418:x1871643125289344:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 2567us (5108us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1784938313.165053:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 144 00000040:00080000:0.0:1784938313.165204:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938313.165209:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938313.166027:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1784938313.166043:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938313.182270:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938313.182323:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125289600 00000100:00100000:2.0:1784938313.182335:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125289600 00000100:00100000:2.0:1784938313.182408:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:2.0:1784938313.182423:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:11418:x1871643125289600:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784938313.183356:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:11418:x1871643125289600:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 929us (1093us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1784938313.183368:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000040:00080000:3.0:1784938313.293474:0:14310:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938313.293489:0:14310:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938313.293540:0:14310:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784938313.293549:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784938313.311330:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938313.342763:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938313.342813:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938313.342841:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938313.342877:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938313.342898:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938313.342926:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938313.342965:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125289856 00000100:00100000:2.0:1784938313.342991:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125289856 00000100:00100000:2.0:1784938313.343084:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125290368 00000100:00100000:2.0:1784938313.343087:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125290368 00000100:00100000:2.0:1784938313.343110:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125290240 00000100:00100000:2.0:1784938313.343112:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125290240 00000100:00100000:2.0:1784938313.343136:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 322 00000100:00100000:2.0:1784938313.343147:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125289856:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.343748:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125289856:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 598us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938313.343760:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 322 00000100:00100000:2.0:1784938313.343794:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 323 00000100:00100000:2.0:1784938313.343803:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125290368:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.343837:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125290368:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938313.343844:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 323 00000100:00100000:2.0:1784938313.343856:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 324 00000100:00100000:2.0:1784938313.343864:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125290240:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.343889:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125290240:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938313.343908:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 324 00000100:00100000:2.0:1784938313.343934:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125289728 00000100:00100000:2.0:1784938313.343940:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125289728 00000100:00100000:2.0:1784938313.343971:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 390 00000100:00100000:2.0:1784938313.343977:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125289728:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.344005:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125289728:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938313.344012:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 390 00000100:00100000:2.0:1784938313.344048:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125290112 00000100:00100000:2.0:1784938313.344052:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125290112 00000100:00100000:2.0:1784938313.344081:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125289984 00000100:00100000:2.0:1784938313.344083:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125289984 00000100:00100000:2.0:1784938313.344106:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:2.0:1784938313.344111:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125290112:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.344137:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125290112:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938313.344143:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:2.0:1784938313.344154:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:2.0:1784938313.344159:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2395:x1871643125289984:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.344182:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2395:x1871643125289984:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938313.344188:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00080000:2.0:1784938313.344209:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938313.344247:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938313.344251:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938313.344504:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938313.382947:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144241280:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938313.383401:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.384330:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144241408:0@lo:400:kworker.0 00000100:00100000:1.0:1784938313.384406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938313.384457:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144241920:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.384512:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144242432:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938313.384629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144241408 00000100:00100000:3.0:1784938313.384640:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144241408 00000100:00100000:3.0:1784938313.384717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1784938313.384730:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144241408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938313.384804:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144241408:12345-0@lo:400:kworker.0 Request processed in 76us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938313.384813:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1784938313.384991:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.385383:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144241408:0@lo:400:kworker.0 00000100:00100000:1.0:1784938313.385407:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784938313.385417:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144241536:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.385454:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144242048:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.385484:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144242560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.385669:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144241920 00000100:00100000:1.0:1784938313.385676:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144241920 00000100:00100000:1.0:1784938313.385717:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 189 00000100:00100000:1.0:1784938313.385726:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144241920:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.385770:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144241920:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 44us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938313.385777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 189 00000100:00100000:1.0:1784938313.385807:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144241664:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.385843:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144242176:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.385903:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144242688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.385936:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784938313.385944:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144241792:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.385970:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144242304:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.385993:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144242816:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.386258:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.386805:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.386848:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.386883:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.386921:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.387013:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.387038:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.387082:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.387102:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.387119:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938313.387150:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144242176 00000100:00100000:1.0:1784938313.387158:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144242176 00000100:00100000:1.0:1784938313.387247:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144241792 00000100:00100000:1.0:1784938313.387251:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144241792 00000100:00100000:1.0:1784938313.387267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144241536 00000100:00100000:1.0:1784938313.387270:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144241536 00000100:00100000:1.0:1784938313.387302:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144242048 00000100:00100000:1.0:1784938313.387305:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144242048 00000100:00100000:1.0:1784938313.387322:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144242560 00000100:00100000:1.0:1784938313.387325:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144242560 00000100:00100000:1.0:1784938313.387340:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144242688 00000100:00100000:1.0:1784938313.387343:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144242688 00000100:00100000:1.0:1784938313.387384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 325 00000100:00100000:1.0:1784938313.387394:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144242176:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.387475:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144242176:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 81us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938313.387484:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 325 00000100:00100000:1.0:1784938313.387504:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 326 00000100:00100000:1.0:1784938313.387511:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144241792:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938313.387678:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 327 00000100:00100000:3.0:1784938313.387689:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144241536:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938313.387722:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144241536:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 36us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938313.387735:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 327 00000100:00100000:3.0:1784938313.387752:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 328 00000100:00100000:3.0:1784938313.387758:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144242048:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938313.387785:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144242048:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938313.387790:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 328 00000100:00100000:3.0:1784938313.387802:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 329 00000100:00100000:3.0:1784938313.387808:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144242560:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938313.387831:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144242560:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938313.387837:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 329 00000100:00100000:3.0:1784938313.387852:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 330 00000100:00100000:3.0:1784938313.387859:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144242688:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938313.387883:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144242688:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938313.387889:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 330 00000100:00100000:3.0:1784938313.387913:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144242432 00000100:00100000:3.0:1784938313.387917:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144242432 00000100:00100000:0.0:1784938313.387927:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144241280 00000100:00100000:0.0:1784938313.387935:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144241280 00000100:00100000:3.0:1784938313.387955:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144242816 00000100:00100000:3.0:1784938313.387959:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144242816 00000100:00100000:3.0:1784938313.387984:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144242304 00000100:00100000:3.0:1784938313.387989:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144242304 00000100:00100000:0.0:1784938313.387989:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 140 00000100:00100000:0.0:1784938313.388003:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1871643144241280:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938313.388016:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 126 00000100:00100000:3.0:1784938313.388025:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1871643144242432:12345-192.168.203.126@tcp:400:kworker.0 00002000:00000024:0.0:1784938313.388041:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784938313.388069:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1871643144242432:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 45us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938313.388076:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 126 00000100:00100000:3.0:1784938313.388091:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 127 00000100:00100000:0.0:1784938313.388101:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1871643144241280:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 100us (4702us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938313.388102:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144242816:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938313.388115:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 140 00000100:00100000:3.0:1784938313.388138:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144242816:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 39us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938313.388146:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 127 00000100:00100000:0.0:1784938313.388153:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144241664 00000100:00100000:0.0:1784938313.388159:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144241664 00000100:00100000:3.0:1784938313.388163:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 128 00000100:00100000:3.0:1784938313.388173:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144242304:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938313.388197:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 190 00000100:00100000:3.0:1784938313.388199:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144242304:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938313.388209:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144241664:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938313.388210:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 128 00000100:00100000:0.0:1784938313.388261:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144241664:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 56us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938313.388269:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 190 00000100:00100000:3.0:1784938313.388758:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144241280:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938313.391788:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144241792:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 4253us (4916us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938313.391809:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 326 00000100:00080000:1.0:1784938313.391902:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938313.391910:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938313.391914:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938313.391919:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938313.392186:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144241536:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.392204:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144242048:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938313.392268:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144242560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938313.392844:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938313.392887:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144242944:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938313.394478:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144241920:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938313.400642:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938313.400825:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144242944 00000100:00100000:0.0:1784938313.400837:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144242944 00000100:00100000:0.0:1784938313.400905:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 141 00000100:00100000:0.0:1784938313.400917:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144242944:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938313.400954:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784938313.401012:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144242944:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 98us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938313.401021:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 141 00000100:00100000:0.0:1784938313.401311:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144242944:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938313.404140:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144242432:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.404425:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144241792:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.404478:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144242304:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.404495:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144242816:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938313.404511:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144241664:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938313.407933:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7dc0000 x1871643144242176/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938313.407969:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144242176:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938313.408023:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd204a680 x1871643144242688/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938313.408033:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144242688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938313.537050:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938313.537273:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125290624 00000100:00100000:3.0:1784938313.537287:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125290624 00000100:00100000:3.0:1784938313.537368:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:3.0:1784938313.537379:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:11431:x1871643125290624:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938313.537415:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938313.537442:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eec53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28823 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.537601:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eec5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.537634:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eec5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.537649:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eec5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938313.537664:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784938313.537805:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59eec53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28823 expref: 28 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.537827:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eec5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28823 expref: 27 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938313.537838:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:3.0:1784938313.537841:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784938313.537847:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0400, rc 0) 00000100:00100000:3.0:1784938313.537934:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:11431:x1871643125290624:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 556us (900us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1784938313.537942:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:0.0:1784938313.545411:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938313.546519:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125290752 00000100:00100000:1.0:1784938313.546548:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125290752 00000100:00100000:1.0:1784938313.546645:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:1.0:1784938313.546658:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:11431:x1871643125290752:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1784938313.546774:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938313.546798:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938313.546813:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938313.546862:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938313.546870:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938313.546878:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938313.546885:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938313.546891:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938313.546900:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938313.546914:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:1.0:1784938313.546919:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938313.546924:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938313.546930:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eec68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938313.547055:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:11431:x1871643125290752:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 399us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938313.547065:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:0.0:1784938313.663815:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938313.663891:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125290880 00000100:00100000:3.0:1784938313.663906:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125290880 00000100:00100000:3.0:1784938313.663994:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:3.0:1784938313.664008:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125290880:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:3.0:1784938313.664037:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938313.664067:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59eec6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2882a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938313.664199:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a63ff46, atime: 0x6a63ff46, ctime: 0x6a63ff46, blocks: 0x8 00010000:00010000:2.0:1784938313.664571:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1784938313.664580:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938313.664596:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59eec6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2882a expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938313.664623:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59eec6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2882a expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938313.664641:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1000, rc 0) 00000100:00100000:2.0:1784938313.664731:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2395:x1871643125290880:12345-192.168.203.26@tcp:101:cat.0 Request processed in 726us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938313.664740:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1784938313.677993:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938313.678252:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125291008 00000100:00100000:3.0:1784938313.678264:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125291008 00002000:00100000:3.0:1784938313.678330:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff910bc7de9880 x1871643125291008/t0(0) o3->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:544/0 lens 488/0 e 0 to 0 dl 1784938324 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938313.678343:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc7de9880 with x1871643125291008 ext(0->4095) 00002000:00010000:3.0:1784938313.678350:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910bc7de9880 00000100:00100000:3.0:1784938313.678384:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:3.0:1784938313.678393:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2393:x1871643125291008:12345-192.168.203.26@tcp:3:cat.0 00000100:00100000:3.0:1784938313.678783:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2393:x1871643125291008:12345-192.168.203.26@tcp:3:cat.0 Request processed in 388us (802us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784938313.678792:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00002000:00100000:3.0:1784938313.678799:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff910bc7de9880 x1871643125291008/t0(0) o3->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:544/0 lens 488/4536 e 0 to 0 dl 1784938324 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938313.678808:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc7de9880 with x1871643125291008 ext(0->4095) 00002000:00010000:3.0:1784938313.678811:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910bc7de9880 00010000:00010000:2.0:1784938314.339149:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938314.399549:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144243072:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938314.399985:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938314.400010:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144243200:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938314.400026:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144243072 00000100:00100000:1.0:1784938314.400035:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144243072 00000100:00100000:1.0:1784938314.400100:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 142 00000100:00100000:1.0:1784938314.400112:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1871643144243072:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938314.400150:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938314.400162:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938314.400191:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144243200 00000100:00100000:1.0:1784938314.400198:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1871643144243072:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938314.400204:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 142 00000100:00100000:2.0:1784938314.400208:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144243200 00000100:00100000:2.0:1784938314.400273:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 143 00000100:00100000:2.0:1784938314.400281:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144243200:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938314.400295:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938314.400330:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144243200:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 44us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938314.400336:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 143 00000100:00100000:1.0:1784938314.400471:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144243072:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938314.400558:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144243200:192.168.203.126@tcp:13:osp-pre-0-1.0 00000040:00080000:0.0:1784938315.233782:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938315.233798:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938315.233824:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784938315.233846:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784938315.361659:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938315.431410:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144243328:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938315.431928:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938315.431977:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144243328 00000100:00100000:1.0:1784938315.431987:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144243328 00000100:00100000:1.0:1784938315.432055:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 191 00000100:00100000:1.0:1784938315.432066:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144243328:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:1.0:1784938315.432113:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1784938315.432164:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144243328:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 99us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938315.432173:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 191 00000100:00100000:3.0:1784938315.439461:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144243328:192.168.203.126@tcp:41:osp-pre-0-1.0 00000040:00080000:0.0:1784938315.488096:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1784938315.942830:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1784938315.942861:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:2.0:1784938316.395502:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938316.960847:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144243456:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938316.962579:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938316.963429:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144243456 00000100:00100000:1.0:1784938316.963441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144243456 00000100:00100000:1.0:1784938316.963515:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 192 00000100:00100000:1.0:1784938316.963526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144243456:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938316.963565:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938316.963647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144243456:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 121us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938316.963655:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 192 00000100:00100000:1.0:1784938316.965108:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144243456:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:2.0:1784938317.407381:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784938317.988552:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1784938317.988567:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1784938317.988935:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1784938317.988960:0:6492:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910cfd498480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1784938317.988965:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910bc17b5b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910cfd498000 00000020:00080000:1.0:1784938317.988968:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910bc17b5500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910bc7f29600 00000020:00080000:1.0:1784938317.988989:0:6492:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1784938317.989037:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938317.989049:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938317.989056:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938317.989063:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938317.989068:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938317.989075:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938317.989095:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff910bc73b3700) 00010000:00010000:3.0:1784938317.989098:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938317.989103:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938317.989110:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eebea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784938317.989571:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1784938317.989781:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1784938318.441864:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938318.460741:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938318.460778:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938318.460799:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938318.460824:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938318.460846:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938318.460872:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938318.460898:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938318.460927:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125291264 00000100:00100000:2.0:1784938318.460936:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125291264 00000100:00100000:2.0:1784938318.460988:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125291776 00000100:00100000:2.0:1784938318.460991:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125291776 00000100:00100000:2.0:1784938318.461007:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125291392 00000100:00100000:2.0:1784938318.461009:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125291392 00000100:00100000:2.0:1784938318.461042:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125291904 00000100:00100000:2.0:1784938318.461045:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125291904 00000100:00100000:2.0:1784938318.461061:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 331 00000100:00100000:2.0:1784938318.461070:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:2392:x1871643125291264:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.461144:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:2392:x1871643125291264:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 75us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.461152:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 331 00000100:00100000:2.0:1784938318.461169:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 332 00000100:00100000:2.0:1784938318.461175:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125291776:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.461200:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125291776:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.461206:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 332 00000100:00100000:2.0:1784938318.461257:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 333 00000100:00100000:2.0:1784938318.461265:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125291392:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.461292:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125291392:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.461299:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 333 00000100:00100000:2.0:1784938318.461314:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 334 00000100:00100000:2.0:1784938318.461320:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125291904:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.461346:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125291904:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.461351:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 334 00000100:00100000:1.0:1784938318.465090:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125291520 00000100:00100000:1.0:1784938318.465106:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125291520 00000100:00100000:1.0:1784938318.465170:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125291648 00000100:00100000:1.0:1784938318.465174:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125291648 00000100:00100000:1.0:1784938318.465206:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:3.0:1784938318.465469:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:3.0:1784938318.465484:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125291648:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938318.465936:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125291648:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 458us (5062us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938318.465945:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:1.0:1784938318.466753:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125291520:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.466803:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125291520:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1589us (6025us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938318.466823:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:1.0:1784938318.466863:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125291136 00000100:00100000:1.0:1784938318.466870:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125291136 00000100:00100000:1.0:1784938318.466914:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 392 00000100:00100000:1.0:1784938318.466924:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125291136:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.466956:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125291136:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (6131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938318.466961:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 392 00000100:00080000:1.0:1784938318.466995:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938318.467000:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938318.467003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938318.467005:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938318.495407:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144243584:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938318.495522:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144243712:0@lo:400:kworker.0 00000100:00100000:0.0:1784938318.495562:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144244224:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938318.495578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938318.495605:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144244736:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938318.495616:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144244096:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938318.495635:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144245248:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938318.495652:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144244608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938318.495683:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784938318.495688:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144245120:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938318.495695:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144243840:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938318.495728:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784938318.495731:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144244352:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938318.495742:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144243968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938318.495755:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144244864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938318.495781:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144244480:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938318.495829:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144244992:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938318.495908:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144243712 00000100:00100000:3.0:1784938318.495915:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144243712 00000100:00100000:1.0:1784938318.495958:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144245376:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938318.495974:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1784938318.496073:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144243712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938318.496155:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144243712:12345-0@lo:400:kworker.0 Request processed in 171us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938318.496162:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1784938318.496243:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144243712:0@lo:400:kworker.0 00000100:00100000:2.0:1784938318.498458:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498489:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498554:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498575:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498606:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498630:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498648:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498665:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498683:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498704:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938318.498728:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144244096 00000100:00100000:2.0:1784938318.498735:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144244096 00000100:00100000:2.0:1784938318.498774:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144243840 00000100:00100000:2.0:1784938318.498777:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144243840 00000100:00100000:2.0:1784938318.498787:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144244352 00000100:00100000:2.0:1784938318.498800:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144244352 00000100:00100000:2.0:1784938318.498822:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144244480 00000100:00100000:2.0:1784938318.498825:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144244480 00000100:00100000:2.0:1784938318.498841:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 335 00000100:00100000:2.0:1784938318.498849:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144244096:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.498918:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144244096:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 69us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.498926:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 335 00000100:00100000:2.0:1784938318.498944:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 336 00000100:00100000:2.0:1784938318.498951:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144243840:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.498974:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144243840:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.498981:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 336 00000100:00100000:2.0:1784938318.499002:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 337 00000100:00100000:2.0:1784938318.499008:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144244352:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.499032:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144244352:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.499038:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 337 00000100:00100000:2.0:1784938318.499049:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 338 00000100:00100000:2.0:1784938318.499055:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144244480:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.499076:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144244480:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.499081:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 338 00000100:00100000:2.0:1784938318.499098:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144244736 00000100:00100000:2.0:1784938318.499101:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144244736 00000100:00100000:2.0:1784938318.499119:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144244608 00000100:00100000:2.0:1784938318.499122:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144244608 00000100:00100000:2.0:1784938318.499132:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144245248 00000100:00100000:2.0:1784938318.499134:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144245248 00000100:00100000:2.0:1784938318.499144:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144245120 00000100:00100000:2.0:1784938318.499146:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144245120 00000100:00100000:2.0:1784938318.499158:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 131 00000100:00100000:2.0:1784938318.499164:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144244736:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.499188:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144244736:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.499194:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 131 00000100:00100000:2.0:1784938318.499206:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 132 00000100:00100000:2.0:1784938318.499232:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144244608:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.499254:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144244608:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 42us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.499266:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 132 00000100:00100000:2.0:1784938318.499279:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 133 00000100:00100000:2.0:1784938318.499285:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144245248:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.499307:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144245248:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.499313:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 133 00000100:00100000:2.0:1784938318.499323:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 134 00000100:00100000:2.0:1784938318.499329:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144245120:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.499346:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144245120:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938318.499351:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 134 00010000:00080000:2.0:1784938318.499588:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffc34700 x1871643144244480/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938318.499603:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144244480:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.499617:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144244096:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938318.499627:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144244608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938318.500791:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938318.500817:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938318.500849:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144244864 00000100:00100000:0.0:1784938318.500856:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144244864 00000100:00100000:0.0:1784938318.500890:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144244992 00000100:00100000:0.0:1784938318.500894:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144244992 00000100:00100000:0.0:1784938318.500912:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 339 00000100:00100000:0.0:1784938318.500921:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144244864:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938318.500976:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144244864:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 56us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938318.500983:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 339 00000100:00100000:0.0:1784938318.501000:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 340 00000100:00100000:0.0:1784938318.501007:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144244992:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938318.501031:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144244992:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938318.501037:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 340 00000100:00100000:0.0:1784938318.501074:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144245120:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938318.501467:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc875c380 x1871643144244992/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938318.501481:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144244992:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.501939:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938318.501966:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144244224 00000100:00100000:1.0:1784938318.501972:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144244224 00000100:00100000:1.0:1784938318.502002:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144243968 00000100:00100000:1.0:1784938318.502005:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144243968 00000100:00100000:1.0:1784938318.502019:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 193 00000100:00100000:1.0:1784938318.502027:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144244224:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.502068:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144244224:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 42us (3619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938318.502075:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 193 00000100:00100000:1.0:1784938318.502093:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 194 00000100:00100000:1.0:1784938318.502100:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144243968:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.502140:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144243968:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 41us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938318.502146:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 194 00000100:00100000:1.0:1784938318.502165:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144243584 00000100:00100000:1.0:1784938318.502169:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144243584 00000100:00100000:1.0:1784938318.502192:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144245376 00000100:00100000:1.0:1784938318.502195:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144245376 00000100:00100000:1.0:1784938318.502207:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 144 00000100:00100000:2.0:1784938318.502688:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144243968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.502973:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144243584:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938318.503001:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784938318.503038:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144243584:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 825us (4548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938318.503044:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 144 00000100:00100000:1.0:1784938318.503059:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 145 00000100:00100000:1.0:1784938318.503066:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144245376:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938318.503076:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784938318.503090:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144245376:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 25us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938318.503096:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 145 00000100:00080000:1.0:1784938318.503126:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938318.503131:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938318.503133:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938318.503136:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938318.503267:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1784938318.503273:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910cffb54000, transno 4294967311 00000004:00080000:1.0:1784938318.503281:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1784938318.503311:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144245376:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938318.503416:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144243840:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.503427:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144244352:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.503437:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144244864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.503457:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144244224:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.503467:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1784938318.503470:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1784938318.503479:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910cd2077b80, transno 4294967305 00000100:00100000:1.0:1784938318.503487:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144244736:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.503509:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144245248:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938318.503522:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144243584:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938319.198439:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938319.202376:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125292032 00000100:00100000:0.0:1784938319.202396:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125292032 00000100:00100000:1.0:1784938319.202988:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:1.0:1784938319.203001:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11083:x1871643125292032:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1784938319.203132:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11083:x1871643125292032:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 133us (4701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938319.203140:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:3.0:1784938319.204798:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938319.205090:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125292160 00000100:00100000:1.0:1784938319.205100:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125292160 00000100:00100000:1.0:1784938319.205166:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:1.0:1784938319.205178:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:11083:x1871643125292160:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1784938319.205391:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:11083:x1871643125292160:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 215us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938319.205399:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:3.0:1784938319.215906:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938319.216335:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125292416 00000100:00100000:2.0:1784938319.216351:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125292416 00000100:00100000:2.0:1784938319.216432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:2.0:1784938319.216444:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:11083:x1871643125292416:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784938319.218007:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:11083:x1871643125292416:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 1553us (2104us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1784938319.219864:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00010000:00010000:2.0:1784938319.456341:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938319.520915:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144245504:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938319.521276:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938319.521285:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144245632:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938319.521611:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938319.521703:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938319.521733:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144245504 00000100:00100000:0.0:1784938319.521745:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144245504 00000100:00100000:0.0:1784938319.521811:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144245632 00000100:00100000:0.0:1784938319.521816:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144245632 00000100:00100000:0.0:1784938319.521846:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 146 00000100:00100000:0.0:1784938319.521860:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144245504:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938319.521903:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938319.522168:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 147 00000100:00100000:2.0:1784938319.522179:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144245632:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938319.522192:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938319.522251:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144245632:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 74us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938319.522259:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 147 00000100:00100000:3.0:1784938319.522531:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144245632:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938319.523780:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144245504:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 1912us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938319.523794:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 146 00000100:00100000:0.0:1784938319.526678:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144245504:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938319.559185:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938319.559314:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125292544 00000100:00100000:3.0:1784938319.559325:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125292544 00000100:00100000:3.0:1784938319.559384:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:3.0:1784938319.559394:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:11889:x1871643125292544:12345-192.168.203.26@tcp:101:lsof.0 00010000:00010000:3.0:1784938319.559416:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938319.559440:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eec76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28831 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938319.559523:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938319.559539:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938319.559552:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938319.559605:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784938319.559608:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938319.559641:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938319.559666:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eec76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28831 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938319.559706:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28831 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938319.559716:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:3.0:1784938319.559719:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938319.559722:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0c00, rc 0) 00000100:00100000:3.0:1784938319.559790:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:11889:x1871643125292544:12345-192.168.203.26@tcp:101:lsof.0 Request processed in 398us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938319.559797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 149 00010000:00010000:2.0:1784938320.480707:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938320.544757:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938320.544786:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144245760:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938320.545198:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938320.545362:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144245760 00000100:00100000:2.0:1784938320.545370:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144245760 00000100:00100000:2.0:1784938320.545424:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 195 00000100:00100000:2.0:1784938320.545434:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144245760:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938320.545470:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1784938320.545531:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144245760:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938320.545539:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 195 00000100:00100000:2.0:1784938320.546072:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144245760:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:0.0:1784938321.505344:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938322.080648:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938322.080677:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144245888:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938322.081031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938322.081070:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144245888 00000100:00100000:0.0:1784938322.081078:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144245888 00000100:00100000:0.0:1784938322.081131:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 196 00000100:00100000:0.0:1784938322.081141:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01969050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144245888:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938322.081179:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938322.081268:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01969050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144245888:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 125us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938322.081277:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 196 00000100:00100000:1.0:1784938322.082865:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144245888:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:2.0:1784938322.527446:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938323.552722:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938323.575776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938323.575828:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938323.575851:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938323.575877:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938323.575896:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938323.575916:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938323.575944:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938323.575994:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125293184 00000100:00100000:3.0:1784938323.576007:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125293184 00000100:00100000:3.0:1784938323.576077:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125293056 00000100:00100000:3.0:1784938323.576080:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125293056 00000100:00100000:3.0:1784938323.576105:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:3.0:1784938323.576116:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125293184:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.576208:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125293184:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 94us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.576258:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:3.0:1784938323.576278:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:3.0:1784938323.576285:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125293056:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.576314:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125293056:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.576320:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:3.0:1784938323.576340:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125292928 00000100:00100000:3.0:1784938323.576343:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125292928 00000100:00100000:3.0:1784938323.576376:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125293440 00000100:00100000:3.0:1784938323.576379:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125293440 00000100:00100000:3.0:1784938323.576391:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125292800 00000100:00100000:3.0:1784938323.576393:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125292800 00000100:00100000:3.0:1784938323.576404:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125293312 00000100:00100000:3.0:1784938323.576406:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125293312 00000100:00100000:3.0:1784938323.576418:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 341 00000100:00100000:3.0:1784938323.576425:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125292928:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.576470:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125292928:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.576477:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 341 00000100:00100000:3.0:1784938323.576491:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 342 00000100:00100000:3.0:1784938323.576496:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125293440:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.576522:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125293440:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.576528:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 342 00000100:00100000:3.0:1784938323.576539:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 343 00000100:00100000:3.0:1784938323.576552:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:2392:x1871643125292800:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.576586:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:2392:x1871643125292800:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.576592:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 343 00000100:00100000:3.0:1784938323.576605:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 344 00000100:00100000:3.0:1784938323.576611:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2392:x1871643125293312:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.576639:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2392:x1871643125293312:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.576645:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 344 00000100:00080000:1.0:1784938323.576942:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938323.576948:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938323.576951:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938323.576954:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938323.580725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125292672 00000100:00100000:2.0:1784938323.580750:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125292672 00000100:00100000:2.0:1784938323.580852:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 394 00000100:00100000:2.0:1784938323.580883:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125292672:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.580998:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125292672:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 118us (5238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.581006:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 394 00000100:00100000:0.0:1784938323.615594:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144246016:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938323.615895:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938323.615905:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144246144:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938323.616314:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938323.616413:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938323.617080:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144246400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.619671:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144246656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.620352:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144246016 00000100:00100000:3.0:1784938323.620366:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144246016 00000100:00100000:3.0:1784938323.620602:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144246144 00000100:00100000:3.0:1784938323.620607:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144246144 00000100:00100000:3.0:1784938323.620635:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 148 00000100:00100000:3.0:1784938323.620646:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144246016:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938323.620746:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784938323.620868:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144246272:0@lo:400:kworker.0 00000100:00100000:2.0:1784938323.621049:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144247168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.621096:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784938323.621105:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144246528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.621133:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144247040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.621159:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144247552:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.621201:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 149 00000100:00100000:2.0:1784938323.621228:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144246144:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938323.621244:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784938323.621272:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144246144:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 62us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.621280:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 149 00000100:00100000:2.0:1784938323.621533:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938323.621615:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938323.621645:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938323.621674:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938323.621698:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938323.621743:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144246528 00000100:00100000:2.0:1784938323.621768:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144246528 00000100:00100000:2.0:1784938323.621812:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 197 00000100:00100000:2.0:1784938323.621820:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144246528:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.621874:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144246528:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.621881:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 197 00000100:00100000:2.0:1784938323.621909:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144246656 00000100:00100000:2.0:1784938323.621912:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144246656 00000100:00100000:2.0:1784938323.621938:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144247040 00000100:00100000:2.0:1784938323.621941:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144247040 00000100:00100000:2.0:1784938323.621965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144247552 00000100:00100000:2.0:1784938323.621967:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144247552 00000100:00100000:2.0:1784938323.621983:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 345 00000100:00100000:2.0:1784938323.621989:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144246656:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.622017:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144246656:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.622023:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 345 00000100:00100000:2.0:1784938323.622037:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 346 00000100:00100000:2.0:1784938323.622043:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144247040:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.622069:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144247040:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.622075:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 346 00000100:00100000:2.0:1784938323.622089:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 347 00000100:00100000:2.0:1784938323.622095:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144247552:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.622119:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144247552:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.622137:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 347 00000100:00100000:2.0:1784938323.622394:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144246528:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938323.622412:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cc4834a80 x1871643144247040/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938323.622425:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144247040:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938323.622437:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc7d83480 x1871643144247552/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938323.622445:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144247552:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.622470:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144246656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.622520:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144247168 00000100:00100000:2.0:1784938323.622525:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144247168 00000100:00100000:2.0:1784938323.622565:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 137 00000100:00100000:2.0:1784938323.622573:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144247168:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.622613:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144247168:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 40us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.622619:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 137 00000100:00100000:2.0:1784938323.622712:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144247168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938323.628148:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144246912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938323.628238:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144247424:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938323.628376:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144246144:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938323.631152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938323.631185:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938323.631296:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144246016:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 10647us (14980us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.631313:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 148 00000100:00100000:3.0:1784938323.631528:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144246016:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938323.632145:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938323.632190:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144246400 00000100:00100000:2.0:1784938323.632200:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144246400 00000100:00100000:2.0:1784938323.632290:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144246912 00000100:00100000:2.0:1784938323.632294:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144246912 00000100:00100000:2.0:1784938323.632317:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144247424 00000100:00100000:2.0:1784938323.632319:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144247424 00000100:00100000:2.0:1784938323.632337:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 348 00000100:00100000:2.0:1784938323.632346:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144246400:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.632424:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144246400:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 78us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.632869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 349 00000100:00100000:3.0:1784938323.632886:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144246912:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.632927:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144246912:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 49us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.632946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 349 00000100:00100000:3.0:1784938323.632972:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 350 00000100:00100000:3.0:1784938323.632979:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144247424:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.633006:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144247424:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.633012:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 350 00000100:00100000:2.0:1784938323.633067:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 348 00000100:00100000:1.0:1784938323.643729:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938323.643825:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144246784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938323.643918:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144247296:192.168.203.126@tcp:400:kworker.0 00000100:00080000:1.0:1784938323.643975:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938323.643984:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938323.643987:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938323.643990:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938323.644156:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144246272 00000100:00100000:3.0:1784938323.644168:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144246272 00000100:00100000:3.0:1784938323.644256:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1784938323.644268:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144246272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938323.644346:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3642:x1871643144246272:12345-0@lo:400:kworker.0 Request processed in 81us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.644355:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1784938323.644587:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938323.644626:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938323.644651:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144247296 00000100:00100000:3.0:1784938323.644656:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144247296 00000100:00100000:3.0:1784938323.644700:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 138 00000100:00100000:3.0:1784938323.644708:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144247296:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938323.644751:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144247296:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 44us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.644757:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 138 00000100:00080000:3.0:1784938323.644772:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938323.645108:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144246272:0@lo:400:kworker.0 00000100:00100000:2.0:1784938323.645318:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144246400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.645338:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144246912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.645350:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144247424:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938323.645644:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc4836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144247296:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.646715:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144246784 00000100:00100000:2.0:1784938323.646732:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144246784 00000100:00100000:2.0:1784938323.646829:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 198 00000100:00100000:2.0:1784938323.646840:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144246784:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938323.646947:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144246784:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 108us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.646955:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 198 00000100:00100000:3.0:1784938323.651043:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144246784:192.168.203.126@tcp:400:kworker.0 00000001:00080000:2.0:1784938324.135047:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1784938324.135070:0:6492:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1784938324.135134:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1784938324.135147:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:1.0:1784938324.192544:0:14508:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:12:02 (1784938322) 00010000:00010000:3.0:1784938324.575981:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938324.639573:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938324.639612:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144247680:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938324.640203:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938324.640258:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144247808:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938324.646732:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938324.646954:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144247680 00000100:00100000:2.0:1784938324.646969:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144247680 00000100:00100000:2.0:1784938324.647055:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 150 00000100:00100000:2.0:1784938324.647066:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144247680:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938324.647134:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938324.647260:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144247680:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 194us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938324.647269:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 150 00000100:00100000:2.0:1784938324.651209:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144247680:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938324.662575:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938324.662715:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144247808 00000100:00100000:0.0:1784938324.662729:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144247808 00000100:00100000:0.0:1784938324.662823:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 151 00000100:00100000:0.0:1784938324.662836:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144247808:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:0.0:1784938324.662878:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938324.669173:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144247808:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 6318us (6591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938324.669206:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 151 00000100:00100000:0.0:1784938324.674041:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144247808:192.168.203.126@tcp:13:osp-pre-0-1.0 00000040:00080000:1.0:1784938325.472550:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938325.472564:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938325.472791:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1784938325.472803:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784938325.600665:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938325.664555:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938325.664593:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144247936:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938325.665927:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938325.674639:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144247936 00000100:00100000:0.0:1784938325.674679:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144247936 00000100:00100000:0.0:1784938325.674898:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 199 00000100:00100000:0.0:1784938325.674913:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144247936:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938325.674979:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1784938325.675088:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144247936:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 178us (9171us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938325.675118:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 199 00000100:00100000:1.0:1784938325.678930:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144247936:192.168.203.126@tcp:41:osp-pre-0-1.0 00000040:00080000:0.0:1784938325.729564:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784938325.861875:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938325.862621:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125293696 00000100:00100000:3.0:1784938325.862635:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125293696 00000100:00100000:3.0:1784938325.862731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:3.0:1784938325.862746:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:12156:x1871643125293696:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938325.862772:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938325.862800:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eec84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28838 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.862889:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.862908:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.862920:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.862936:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.862943:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.862949:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863084:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eec99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863093:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eec99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863100:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eec99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938325.863110:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1784938325.863208:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863269:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863277:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863284:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938325.863289:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863298:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863313:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910cfd58b700) 00010000:00010000:3.0:1784938325.863316:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938325.863322:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863339:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eec8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863356:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863361:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863367:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863373:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938325.863375:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863381:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863388:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff910cc2a19a00) 00010000:00010000:3.0:1784938325.863390:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938325.863392:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863398:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eec92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863799:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eec84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28838 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863818:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eec99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28838 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938325.863833:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:3.0:1784938325.863835:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938325.863839:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0000, rc 0) 00000100:00100000:3.0:1784938325.863933:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:12156:x1871643125293696:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1191us (2072us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1784938325.863942:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00080000:1.0:1784938325.866523:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938325.870176:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938325.870311:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125293824 00000100:00100000:2.0:1784938325.870324:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125293824 00000100:00100000:2.0:1784938325.870409:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:2.0:1784938325.870421:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:2395:x1871643125293824:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938325.870442:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938325.870492:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eec99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28838 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938325.870529:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:2.0:1784938325.870535:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938325.870610:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:2395:x1871643125293824:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 193us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938325.870618:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1784938325.871430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938325.871659:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125293952 00000100:00100000:2.0:1784938325.871668:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125293952 00000100:00100000:2.0:1784938325.871718:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:2.0:1784938325.871727:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:12156:x1871643125293952:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784938325.871868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:12156:x1871643125293952:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 141us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938325.871877:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:1.0:1784938325.884489:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938325.884611:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125294080 00000100:00100000:2.0:1784938325.884624:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125294080 00000100:00100000:2.0:1784938325.884724:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 152 00000100:00100000:2.0:1784938325.884737:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:12156:x1871643125294080:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784938325.884896:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:12156:x1871643125294080:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 162us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938325.884904:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 152 00000100:00080000:1.0:1784938325.885040:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1784938326.502623:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938326.502638:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784938326.503176:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1784938326.503188:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784938326.627540:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938326.753712:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784938327.199759:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144248064:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938327.200140:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938327.200180:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144248064 00000100:00100000:1.0:1784938327.200189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144248064 00000100:00100000:1.0:1784938327.200277:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 200 00000100:00100000:1.0:1784938327.200289:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144248064:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938327.200339:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938327.200396:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144248064:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 108us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938327.200405:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 200 00000100:00100000:0.0:1784938327.211500:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144248064:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938327.652489:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938328.398319:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938328.398495:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125294208 00000100:00100000:3.0:1784938328.398507:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125294208 00000100:00100000:3.0:1784938328.398586:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00100000:3.0:1784938328.398596:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:12198:x1871643125294208:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938328.398617:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938328.398639:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eeca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2883f expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398702:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398717:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398731:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398745:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398752:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398771:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398820:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398827:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398834:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398839:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938328.398844:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398852:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398863:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:3.0:1784938328.398866:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938328.398870:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398877:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eecae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398889:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398895:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398907:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398912:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938328.398915:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398921:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398928:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff910cc2a19a00) 00010000:00010000:3.0:1784938328.398930:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938328.398933:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398938:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398973:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eeca7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2883f expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.398984:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:3.0:1784938328.398986:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938328.398990:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eeca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2883f expref: 15 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.399000:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1a00, rc 0) 00000100:00100000:3.0:1784938328.399063:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:12198:x1871643125294208:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 468us (751us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938328.399081:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00080000:0.0:1784938328.399179:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938328.415278:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938328.415318:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125294464 00000100:00100000:0.0:1784938328.415327:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125294464 00000100:00100000:0.0:1784938328.415382:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:0.0:1784938328.415391:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+14:12198:x1871643125294464:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:0.0:1784938328.415455:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938328.415482:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cd9246c00/0x26783cd1c59ee5fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28663 expref: 14 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.415500:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:0.0:1784938328.415506:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938328.415566:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.415581:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28831 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.415590:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.415629:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28831 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.415642:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28831 expref: 5 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938328.415656:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7d83480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144248192:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938328.415740:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938328.427311:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938328.427353:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125294592 00000100:00100000:0.0:1784938328.427361:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125294592 00010000:00010000:0.0:1784938328.427408:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28831 expref: 6 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938328.427455:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:0.0:1784938328.427464:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2392:x1871643125294592:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938328.427477:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938328.427484:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28831 expref: 6 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.427497:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28831 expref: 6 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.427519:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:0.0:1784938328.427525:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.427551:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.427559:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.427577:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938328.427622:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2392:x1871643125294592:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 159us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938328.427629:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00080000:0.0:1784938328.427649:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784938328.427776:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eec7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28831 expref: 5 pid: 6514 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938328.428470:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7d83480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144248192:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938328.428493:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.428503:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.428508:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.428532:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.428542:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.428562:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430692:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430714:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430724:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938328.430742:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf6f32df reply state 00000000c21ad5b0 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430753:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430760:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938328.430763:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938328.430767:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784938328.430774:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1784938328.430782:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430788:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430795:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430801:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938328.430815:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430823:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430834:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19e00) 00010000:00010000:0.0:1784938328.430836:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938328.430840:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430847:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eecbc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938328.430866:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf6f32df reply state 00000000c21ad5b0 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430874:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.430880:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff910bc1795400) 00010000:00010000:0.0:1784938328.430882:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938328.430884:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784938328.434526:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:12198:x1871643125294464:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 19121us (19241us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1784938328.434540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:0.0:1784938328.543832:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938328.543913:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125294720 00000100:00100000:3.0:1784938328.543923:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125294720 00000100:00100000:3.0:1784938328.543979:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 155 00000100:00100000:3.0:1784938328.543989:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+15:12206:x1871643125294720:12345-192.168.203.26@tcp:101:lctl.0 00010000:00010000:3.0:1784938328.544013:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938328.544037:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eecd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28846 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.544104:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.544118:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.544129:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938328.544171:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784938328.544175:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938328.544192:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.544247:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eecd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28846 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.544266:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28846 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.544294:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19a00) 00010000:00010000:3.0:1784938328.544297:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938328.544301:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0200, rc 0) 00000100:00100000:3.0:1784938328.544357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:12206:x1871643125294720:12345-192.168.203.26@tcp:101:lctl.0 Request processed in 369us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.544364:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 155 00000100:00100000:3.0:1784938328.596278:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938328.596388:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125294848 00000100:00100000:2.0:1784938328.596405:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125294848 00000100:00100000:2.0:1784938328.596494:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 156 00000100:00100000:2.0:1784938328.596504:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+16:12212:x1871643125294848:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1784938328.596527:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938328.596552:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eecdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2884d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596616:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596630:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596654:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596664:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596671:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596676:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596751:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eecf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596758:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eecf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596764:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eecf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938328.596794:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784938328.596797:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938328.596814:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eecf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596825:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596831:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596847:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596853:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938328.596857:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596864:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596875:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19a00) 00010000:00010000:2.0:1784938328.596877:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938328.596882:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596887:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eece6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596900:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596907:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596913:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596917:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938328.596920:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596933:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596941:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff910bc1795400) 00010000:00010000:2.0:1784938328.596943:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938328.596946:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596952:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeced lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596974:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eecdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2884d expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596984:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eecf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2884d expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.596990:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938328.596991:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938328.596993:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1c00, rc 0) 00000100:00100000:2.0:1784938328.597063:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:12212:x1871643125294848:12345-192.168.203.26@tcp:101:bash.0 Request processed in 560us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.597070:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 156 00000100:00100000:0.0:1784938328.602025:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938328.602197:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125295104 00000100:00100000:2.0:1784938328.602367:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125295104 00000100:00100000:2.0:1784938328.602661:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:2.0:1784938328.602675:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+17:12212:x1871643125295104:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1784938328.602727:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938328.602758:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eecfb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28854 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.602930:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.602949:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.602963:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.602982:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.602990:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.602998:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938328.603758:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1784938328.603961:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.603975:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.603984:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604049:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604057:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604064:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604071:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938328.604077:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604086:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604102:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938328.604106:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938328.604112:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604119:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed02 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938328.604138:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001875e21e reply state 000000004adb88bb transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604151:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604158:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc73b3800) 00010000:00010000:2.0:1784938328.604167:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938328.604171:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938328.604360:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eecfb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28854 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604380:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28854 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.604389:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc73b3c00) 00010000:00010000:2.0:1784938328.604391:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938328.604394:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0a00, rc 0) 00000100:00100000:2.0:1784938328.604634:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:12212:x1871643125295104:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1960us (2622us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1784938328.604644:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:0.0:1784938328.608759:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938328.608976:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125295232 00000100:00100000:3.0:1784938328.608989:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125295232 00000100:00100000:3.0:1784938328.609080:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:3.0:1784938328.609094:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125295232:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1784938328.609122:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938328.609153:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2885b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938328.609189:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938328.609239:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1784938328.609245:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938328.609257:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2885b expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.609280:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2885b expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.609296:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1a00, rc 0) 00000100:00100000:3.0:1784938328.609381:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125295232:12345-192.168.203.26@tcp:101:bash.0 Request processed in 291us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.609389:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00080000:0.0:1784938328.609654:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938328.612361:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938328.612466:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125295360 00000100:00100000:1.0:1784938328.612479:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125295360 00000100:00100000:1.0:1784938328.612564:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:1.0:1784938328.612576:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:12212:x1871643125295360:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938328.612604:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938328.612653:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28862 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938328.612697:0:8770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2885b expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938328.612708:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938328.612713:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938328.612719:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938328.612766:0:8770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2885b expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938328.612782:0:8770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2885b expref: 7 pid: 8430 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938328.612799:0:8770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8770:1871643144248320:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938328.613422:0:8770:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938328.618288:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938328.618600:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125295488 00000100:00100000:2.0:1784938328.618613:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125295488 00010000:00010000:2.0:1784938328.618667:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2885b expref: 8 pid: 8430 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938328.618721:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:2.0:1784938328.618732:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125295488:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938328.618752:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938328.618781:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2885b expref: 8 pid: 8430 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.618798:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2885b expref: 8 pid: 8430 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.618856:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938328.618861:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938328.618872:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.618884:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.618935:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938328.618952:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8481180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1871643144248448:192.168.203.26@tcp:105: 00000100:00100000:2.0:1784938328.619064:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d240 going to sleep for 11 seconds 00010000:00010000:1.0:1784938328.619393:0:8770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000169198d7/0x26783cd1c59eed1e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2885b expref: 8 pid: 8430 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938328.619414:0:8770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8770:1871643144248320:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938328.619690:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938328.619722:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1e00, rc 0) 00000100:00100000:1.0:1784938328.619769:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:12212:x1871643125295360:12345-192.168.203.26@tcp:101:bash.0 Request processed in 7195us (7421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938328.619778:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:0.0:1784938328.626800:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938328.626981:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125295744 00000100:00100000:1.0:1784938328.626994:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125295744 00000100:00100000:1.0:1784938328.627077:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:1.0:1784938328.627090:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:12212:x1871643125295744:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:1.0:1784938328.627770:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:12212:x1871643125295744:12345-192.168.203.26@tcp:35:bash.0 Request processed in 677us (979us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1784938328.627781:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:2.0:1784938328.636493:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8481180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1871643144248448:192.168.203.26@tcp:105: 00010000:00010000:2.0:1784938328.636534:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938328.636648:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125295488:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 17916us (18374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.636663:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 82 00010000:00010000:2.0:1784938328.671925:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938328.699339:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938328.699391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938328.699449:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938328.699484:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938328.699522:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125296000 00000100:00100000:0.0:1784938328.699534:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125296000 00000100:00100000:0.0:1784938328.699902:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125296256 00000100:00100000:0.0:1784938328.699908:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125296256 00000100:00100000:0.0:1784938328.699939:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 351 00000100:00100000:0.0:1784938328.699949:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125296000:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938328.700051:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2395:x1871643125296000:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 103us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938328.700059:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 351 00000100:00100000:0.0:1784938328.700079:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 352 00000100:00100000:0.0:1784938328.700086:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125296256:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938328.700114:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2395:x1871643125296256:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938328.700120:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 352 00000100:00080000:0.0:1784938328.700141:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938328.700869:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125295872 00000100:00100000:3.0:1784938328.700880:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125295872 00000100:00100000:3.0:1784938328.700938:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 396 00000100:00100000:3.0:1784938328.700947:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125295872:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.701004:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125295872:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 59us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.701011:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 396 00000100:00100000:2.0:1784938328.701451:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125296128 00000100:00100000:2.0:1784938328.701458:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125296128 00000100:00100000:2.0:1784938328.701510:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:2.0:1784938328.701519:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125296128:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.701719:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125296128:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 202us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.701745:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00080000:3.0:1784938328.702759:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938328.735998:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144248832:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.736138:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144249344:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.736183:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144249856:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.736241:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1784938328.736248:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144248704:0@lo:400:kworker.0 00000100:00100000:3.0:1784938328.736309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938328.736342:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144249216:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.736370:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144249728:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.736393:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144250240:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.736926:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144248576:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938328.736968:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144249088:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.736991:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144249600:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.737010:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144250112:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.737031:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784938328.737037:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144248960:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.737058:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144249472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.737080:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144249984:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938328.737237:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938328.737250:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144250368:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938328.737293:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144248704 00000100:00100000:1.0:1784938328.737302:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144248704 00000100:00100000:1.0:1784938328.737356:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1784938328.737364:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3643:x1871643144248704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938328.737439:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3643:x1871643144248704:12345-0@lo:400:kworker.0 Request processed in 62us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938328.737447:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1784938328.737506:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7782ae5c-cb83-4240-bccc-1dc097db054d:3643:1871643144248704:0@lo:400:kworker.0 00000100:00100000:0.0:1784938328.737922:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938328.737978:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144249344 00000100:00100000:1.0:1784938328.737983:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144249344 00000100:00100000:1.0:1784938328.738045:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 353 00000100:00100000:1.0:1784938328.738053:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144249344:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938328.738082:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144249344:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 31us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938328.738089:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 353 00000100:00080000:1.0:1784938328.738127:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938328.738204:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938328.738348:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144249216 00000100:00100000:1.0:1784938328.738352:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144249216 00000100:00100000:1.0:1784938328.738390:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 201 00000100:00100000:1.0:1784938328.738396:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144249216:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938328.738434:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144249216:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 29us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938328.738441:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 201 00000100:00100000:2.0:1784938328.739849:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938328.739894:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938328.739929:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938328.739967:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144249728 00000100:00100000:2.0:1784938328.739976:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144249728 00000100:00100000:2.0:1784938328.740032:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 140 00000100:00100000:2.0:1784938328.740042:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144249728:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.740091:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144249728:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.740098:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 140 00000100:00080000:2.0:1784938328.740119:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938328.740131:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144248832 00000100:00100000:2.0:1784938328.740134:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144248832 00000100:00100000:2.0:1784938328.740171:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144249856 00000100:00100000:2.0:1784938328.740174:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144249856 00000100:00100000:2.0:1784938328.740194:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 354 00000100:00100000:2.0:1784938328.740200:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144248832:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.740238:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144248832:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 39us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.740244:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 354 00000100:00100000:2.0:1784938328.740254:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 355 00000100:00100000:2.0:1784938328.740260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144249856:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.740276:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144249856:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.740281:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 355 00000100:00080000:2.0:1784938328.740297:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938328.743453:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938328.743524:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938328.743573:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938328.743598:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938328.743625:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938328.743734:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144249216:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.743756:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144249344:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.743799:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144250240 00000100:00100000:3.0:1784938328.743817:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144250240 00000100:00100000:3.0:1784938328.743890:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144250112 00000100:00100000:3.0:1784938328.743893:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144250112 00000100:00100000:3.0:1784938328.743918:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 141 00000100:00100000:3.0:1784938328.743928:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144250240:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.744011:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144250240:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 84us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.744021:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 141 00000100:00100000:3.0:1784938328.744041:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 142 00000100:00100000:3.0:1784938328.744049:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144250112:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.744076:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144250112:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.744083:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 142 00000100:00100000:3.0:1784938328.744244:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144249088 00000100:00100000:3.0:1784938328.744249:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144249088 00000100:00100000:3.0:1784938328.744278:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144249472 00000100:00100000:3.0:1784938328.744281:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144249472 00000100:00100000:3.0:1784938328.744307:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 356 00000100:00100000:3.0:1784938328.744314:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144249088:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.744360:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144249088:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 46us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.744367:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 356 00000100:00100000:3.0:1784938328.744381:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 357 00000100:00100000:3.0:1784938328.744388:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc8759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144249472:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.744412:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc8759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144249472:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.744418:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 357 00000100:00080000:3.0:1784938328.744546:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938328.744552:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784938328.744586:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2070700 x1871643144249472/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938328.744601:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144249472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.744617:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144249088:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938328.744850:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144250368 00000100:00100000:1.0:1784938328.744855:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144250368 00000100:00100000:1.0:1784938328.744899:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 152 00000100:00100000:1.0:1784938328.744907:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144250368:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938328.744937:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784938328.744976:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144250368:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 71us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938328.744983:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 152 00000100:00100000:2.0:1784938328.746046:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938328.746098:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938328.746133:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938328.746163:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144248960 00000100:00100000:2.0:1784938328.746173:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144248960 00000100:00100000:2.0:1784938328.746242:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 202 00000100:00100000:2.0:1784938328.746253:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144248960:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.746330:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144248960:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.746338:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 202 00000100:00100000:2.0:1784938328.746395:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938328.746418:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144249984 00000100:00100000:2.0:1784938328.746423:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144249984 00000100:00100000:2.0:1784938328.746506:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 358 00000100:00100000:2.0:1784938328.746513:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144249984:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.746544:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144249984:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.747001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 358 00000100:00080000:2.0:1784938328.747029:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938328.747154:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144249728:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.747313:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144248832:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.747375:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144249856:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.747446:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144250240:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938328.747541:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144250368:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938328.747913:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144249600 00000100:00100000:1.0:1784938328.747921:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144249600 00000100:00100000:1.0:1784938328.747987:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 143 00000100:00100000:1.0:1784938328.747997:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc4836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144249600:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938328.748065:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc4836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144249600:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 69us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938328.748086:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 143 00000100:00100000:3.0:1784938328.748184:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144248576 00000100:00100000:3.0:1784938328.748190:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144248576 00000100:00100000:3.0:1784938328.748252:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 153 00000100:00100000:3.0:1784938328.748261:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144248576:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:3.0:1784938328.748279:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784938328.748311:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144248576:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 53us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.748317:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 153 00000100:00100000:3.0:1784938328.748358:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144248960:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938328.748387:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2072a00 x1871643144249984/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938328.748398:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144249984:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.748412:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144250112:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938328.748907:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144248576:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938328.748923:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144249600:192.168.203.126@tcp:400:kworker.0 00000100:00080000:2.0:1784938328.749022:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938328.749271:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938328.749344:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125296512 00000100:00100000:3.0:1784938328.749350:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125296512 00000100:00100000:3.0:1784938328.749448:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00100000:3.0:1784938328.749457:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:12222:x1871643125296512:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938328.749483:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938328.749512:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eed2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28869 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938328.749934:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784938328.750072:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eed2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28869 expref: 23 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.750093:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19a00) 00010000:00010000:3.0:1784938328.750096:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938328.750103:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eed2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28869 expref: 23 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.750121:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0e00, rc 0) 00000100:00100000:3.0:1784938328.750272:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:12222:x1871643125296512:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 815us (1001us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1784938328.750280:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00100000:2.0:1784938328.755018:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938328.755134:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125296768 00000100:00100000:3.0:1784938328.755150:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125296768 00000100:00100000:3.0:1784938328.755321:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:3.0:1784938328.755336:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:12222:x1871643125296768:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1784938328.756169:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:12222:x1871643125296768:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 831us (1161us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1784938328.756180:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:0.0:1784938328.837738:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938328.837893:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125296896 00000100:00100000:3.0:1784938328.837905:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125296896 00000100:00100000:3.0:1784938328.837997:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:3.0:1784938328.838009:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:12228:x1871643125296896:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938328.838050:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938328.838080:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1800/0x26783cd1c59eed3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28870 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.838177:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eed41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.838195:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eed41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.838209:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eed41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938328.838462:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784938328.838467:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938328.838494:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eed41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.838550:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1800/0x26783cd1c59eed3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28870 expref: 25 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.838573:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eed41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28870 expref: 24 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.838584:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938328.838588:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938328.838593:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0e00, rc 0) 00000100:00100000:0.0:1784938328.838779:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:12228:x1871643125296896:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 771us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938328.838788:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:0.0:1784938328.851987:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938328.854775:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125297152 00000100:00100000:2.0:1784938328.854795:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125297152 00000100:00100000:2.0:1784938328.855048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:2.0:1784938328.855061:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:12228:x1871643125297152:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938328.855093:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938328.855122:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eed48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28877 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.855340:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eed4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.855359:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eed4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.855383:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eed4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938328.855399:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784938328.855629:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59eed48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28877 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.855653:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eed4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28877 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.855663:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc73b3c00) 00010000:00010000:2.0:1784938328.855666:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938328.855671:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0400, rc 0) 00000100:00100000:2.0:1784938328.855753:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:12228:x1871643125297152:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 695us (3781us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1784938328.855762:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:2.0:1784938328.859384:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938328.859444:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938328.859541:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125297280 00000100:00100000:0.0:1784938328.859555:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125297280 00000100:00100000:0.0:1784938328.859656:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1784938328.859666:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:2393:x1871643125297280:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938328.859686:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938328.859716:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59eed4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28877 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.859741:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc73b3c00) 00010000:00010000:0.0:1784938328.859747:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938328.860967:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:2393:x1871643125297280:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1293us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938328.860982:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:3.0:1784938328.862392:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125297536 00000100:00100000:3.0:1784938328.862436:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125297536 00000100:00100000:3.0:1784938328.862513:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 161 00000100:00100000:3.0:1784938328.862524:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12228:x1871643125297536:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938328.862555:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938328.862593:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59eed5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2887e expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.862739:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eed64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.862756:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eed64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.862770:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eed64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938328.862785:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784938328.862935:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59eed5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2887e expref: 28 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.862960:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eed64 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2887e expref: 27 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.862970:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc73b3c00) 00010000:00010000:3.0:1784938328.862973:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784938328.862977:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1e00, rc 0) 00000100:00100000:3.0:1784938328.863065:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12228:x1871643125297536:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 543us (3620us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1784938328.863072:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 161 00000100:00100000:2.0:1784938328.876073:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938328.876247:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125297664 00000100:00100000:3.0:1784938328.876260:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125297664 00000100:00100000:3.0:1784938328.876339:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1784938328.876353:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2395:x1871643125297664:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:3.0:1784938328.876414:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.876529:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 6 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.876540:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938328.876545:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938328.876550:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.876598:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 6 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.876615:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 6 pid: 8770 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938328.876635:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1871643144250496:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938328.876759:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc99599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938328.890879:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938328.891073:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125297792 00000100:00100000:1.0:1784938328.891086:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125297792 00002000:00100000:1.0:1784938328.891150:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff910cc489f100 x1871643125297792/t0(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:559/0 lens 504/0 e 0 to 0 dl 1784938339 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938328.891164:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cc489f100 with x1871643125297792 ext(0->12) 00010000:00010000:1.0:1784938328.891176:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 7 pid: 8770 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938328.891195:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 7 pid: 8770 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938328.891204:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910cc489f100 00000100:00100000:1.0:1784938328.891282:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1784938328.891293:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc489f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2393:x1871643125297792:12345-192.168.203.26@tcp:4:lfs.0 00000100:00100000:3.0:1784938328.892358:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1871643144250496:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938328.892395:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938328.894738:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc489f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125297792:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 3430us (3858us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1784938328.894755:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00002000:00100000:1.0:1784938328.894771:0:8435:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff910cc489f100 x1871643125297792/t4294967306(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:559/0 lens 504/448 e 0 to 0 dl 1784938339 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938328.894782:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cc489f100 with x1871643125297792 ext(0->12) 00010000:00010000:1.0:1784938328.894796:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 9 pid: 8770 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938328.895657:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 9 pid: 8770 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938328.895667:0:8435:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910cc489f100 00000100:00100000:1.0:1784938328.898337:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938328.898866:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125297920 00000100:00100000:2.0:1784938328.898881:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125297920 00010000:00010000:2.0:1784938328.898939:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 9 pid: 8770 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938328.898995:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:2.0:1784938328.899006:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2395:x1871643125297920:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938328.899049:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784938328.899076:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784938328.899080:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784938328 00002000:00010000:2.0:1784938328.899082:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784938328 00002000:00010000:2.0:1784938328.899084:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1784938328 00002000:00010000:2.0:1784938328.899087:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784938328.899094:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 9 pid: 8770 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.899110:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 9 pid: 8770 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.899141:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032ebfcdc/0x26783cd1c59eed25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28862 expref: 9 pid: 8770 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.899163:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938328.899168:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938328.899176:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.899186:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.899399:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.899410:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.899453:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.899461:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.899469:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.899476:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938328.899481:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.899491:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.899503:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938328.899604:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2395:x1871643125297664:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 23255us (23545us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938328.899624:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00010000:00010000:2.0:1784938328.900165:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59eed72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.900199:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938328.900282:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2395:x1871643125297920:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1276us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.900291:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:0.0:1784938328.903318:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938328.904316:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125298176 00000100:00100000:2.0:1784938328.904329:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125298176 00000100:00100000:2.0:1784938328.904404:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:2.0:1784938328.904416:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12228:x1871643125298176:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:2.0:1784938328.904539:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eed64 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2887e expref: 27 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938328.904839:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1784938328.904877:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1784938328.906921:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1784938328.907008:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.907034:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28854 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.907043:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.907693:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28854 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.907718:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28854 expref: 31 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938328.907739:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1871643144250624:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938328.908457:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938328.913553:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938328.916068:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125298304 00000100:00100000:3.0:1784938328.916104:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125298304 00010000:00010000:3.0:1784938328.916172:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28854 expref: 32 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938328.916281:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 84 00000100:00100000:3.0:1784938328.916294:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:2392:x1871643125298304:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938328.916316:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938328.916324:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28854 expref: 32 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.916339:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28854 expref: 32 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.916366:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc73b3c00) 00010000:00010000:3.0:1784938328.916372:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.916383:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.916391:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938328.916416:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938328.916502:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:2392:x1871643125298304:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 211us (2967us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.916532:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 84 00010000:00010000:2.0:1784938328.919772:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28854 expref: 31 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938328.920699:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1871643144250624:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938328.920738:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.920753:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.920759:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938328.921328:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1784938328.921968:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1784938328.922715:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144250752:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784938328.923075:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674da80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938328.930280:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938328.930376:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144250752 00000100:00100000:2.0:1784938328.930388:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144250752 00000100:00100000:2.0:1784938328.930491:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 203 00000100:00100000:2.0:1784938328.930503:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1871643144250752:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784938328.940005:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1871643144250752:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 Request processed in 9486us (9724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938328.940026:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 203 00000100:00100000:2.0:1784938328.941167:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144250752:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784938328.941752:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1784938328.941938:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144250880:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784938328.942177:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9959540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938328.942840:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938328.942908:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144250880 00000100:00100000:2.0:1784938328.942944:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144250880 00000100:00100000:2.0:1784938328.943025:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 204 00000100:00100000:2.0:1784938328.943038:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1871643144250880:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784938328.944847:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6515:x1871643144250880:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 Request processed in 1796us (1995us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784938328.944866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 204 00000100:00100000:2.0:1784938328.945520:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144250880:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784938328.946210:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1784938328.946359:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.946373:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.946381:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.946388:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938328.946394:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.946402:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.946656:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc73b3c00) 00010000:00010000:2.0:1784938328.946661:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784938328.946668:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938328.946676:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed79 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938328.946931:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784938328.947016:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1784938328.947031:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396978815368ns, next at 397978812556ns, rc = 0 00000001:00080000:2.0:1784938328.947039:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1784938328.947072:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc73b3c00) 00010000:00010000:2.0:1784938328.947075:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784938328.947147:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59eed64 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2887e expref: 35 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938328.947375:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:12228:x1871643125298176:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 42959us (44072us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1784938328.947386:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000020:00080000:2.0:1784938328.947394:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784938328.949990:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938328.950198:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125298432 00000100:00100000:0.0:1784938328.950211:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125298432 00000100:00100000:0.0:1784938328.950309:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 162 00000100:00100000:0.0:1784938328.950320:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:12228:x1871643125298432:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938328.950352:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938328.950381:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eed80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28885 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.950733:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eed80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28885 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.950751:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eed80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28885 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938328.950774:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938328.950777:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938328.950781:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77e00, rc 0) 00000100:00100000:0.0:1784938328.951349:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:12228:x1871643125298432:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1027us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938328.951358:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 162 00000100:00100000:3.0:1784938328.956134:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938328.956206:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125298688 00000100:00100000:2.0:1784938328.956269:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125298688 00000100:00100000:2.0:1784938328.956328:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:2.0:1784938328.956339:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:12228:x1871643125298688:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1784938328.957175:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+36:12228:x1871643125298688:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 828us (1049us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1784938328.957188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:3.0:1784938329.094742:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938329.095497:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125298944 00000100:00100000:2.0:1784938329.095513:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125298944 00000100:00100000:2.0:1784938329.096376:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 163 00000100:00100000:2.0:1784938329.096395:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+36:12238:x1871643125298944:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938329.096492:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938329.096545:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2888c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938329.097436:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784938329.098098:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2888c expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.098122:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19a00) 00010000:00010000:2.0:1784938329.098125:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938329.098131:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eed87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2888c expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.098153:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1e00, rc 0) 00000100:00100000:2.0:1784938329.098953:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:12238:x1871643125298944:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 2558us (4393us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1784938329.098973:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 163 00000100:00100000:0.0:1784938329.113444:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938329.113565:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125299072 00000100:00100000:2.0:1784938329.113579:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125299072 00000100:00100000:2.0:1784938329.113664:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:2.0:1784938329.113676:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:12238:x1871643125299072:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:2.0:1784938329.113800:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.113824:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.113841:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.113879:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.113888:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.113895:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.113997:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114006:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114013:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938329.114076:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114093:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114100:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114109:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114116:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938329.114121:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114142:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114156:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938329.114159:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938329.114165:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114171:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eed95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114187:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114192:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114198:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114203:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938329.114205:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114211:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114258:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc73b3800) 00010000:00010000:2.0:1784938329.114261:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938329.114264:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114279:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eed9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114292:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114299:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114304:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114309:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938329.114311:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114317:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114326:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:2.0:1784938329.114328:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938329.114331:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.114336:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeda3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938329.114447:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:12238:x1871643125299072:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 771us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938329.114455:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:3.0:1784938329.116650:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938329.117111:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125299328 00000100:00100000:1.0:1784938329.117123:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125299328 00000100:00100000:1.0:1784938329.117255:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:1.0:1784938329.117267:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:12238:x1871643125299328:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938329.117572:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:12238:x1871643125299328:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 306us (1039us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1784938329.117580:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:0.0:1784938329.165750:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938329.165843:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125299584 00000100:00100000:1.0:1784938329.165856:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125299584 00000100:00100000:1.0:1784938329.165936:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:1.0:1784938329.165948:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:12241:x1871643125299584:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938329.165981:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938329.166013:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eedaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28893 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166114:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166167:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166182:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166196:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166204:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166210:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166398:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166407:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166415:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938329.166440:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784938329.166541:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166550:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166558:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166572:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938329.166578:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166587:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166601:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938329.166604:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938329.166610:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166616:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eedb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166632:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166639:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166644:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166650:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938329.166652:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166658:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166675:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc73b3800) 00010000:00010000:1.0:1784938329.166678:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938329.166680:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166686:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eedb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166729:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eedaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28893 expref: 41 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166743:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28893 expref: 40 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.166751:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:1.0:1784938329.166754:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938329.166756:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1600, rc 0) 00000100:00100000:1.0:1784938329.166836:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+40:12241:x1871643125299584:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 890us (1102us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1784938329.166845:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:0.0:1784938329.173338:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938329.173496:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125299712 00000100:00100000:2.0:1784938329.173509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125299712 00000100:00100000:2.0:1784938329.173691:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00100000:2.0:1784938329.173704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+40:12241:x1871643125299712:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:2.0:1784938329.173809:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.173833:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.173848:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.173897:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.173905:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.173914:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.173921:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938329.173927:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.173936:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.173951:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:2.0:1784938329.173955:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938329.173961:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.173978:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938329.174087:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+40:12241:x1871643125299712:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 385us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938329.174096:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00100000:0.0:1784938329.176362:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938329.176467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125299968 00000100:00100000:3.0:1784938329.176480:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125299968 00000100:00100000:3.0:1784938329.176562:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:3.0:1784938329.176580:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+40:12241:x1871643125299968:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1784938329.176882:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+41:12241:x1871643125299968:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 309us (532us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1784938329.176890:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1784938329.416577:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938329.416713:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125300224 00000100:00100000:3.0:1784938329.416727:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125300224 00000100:00100000:3.0:1784938329.416804:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:3.0:1784938329.416816:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+41:12273:x1871643125300224:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:3.0:1784938329.416853:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938329.416884:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eedd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2889a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.417054:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eeddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.417084:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eeddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.417098:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eeddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938329.417113:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784938329.417319:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eedd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2889a expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.417345:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eeddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2889a expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.417355:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:3.0:1784938329.417358:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938329.417363:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0c00, rc 0) 00000100:00100000:3.0:1784938329.417446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+43:12273:x1871643125300224:12345-192.168.203.26@tcp:101:cat.0 Request processed in 632us (885us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1784938329.417454:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:3.0:1784938329.421986:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938329.422173:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125300352 00000100:00100000:1.0:1784938329.422185:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125300352 00000100:00100000:1.0:1784938329.422317:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1784938329.422330:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+43:2392:x1871643125300352:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938329.422352:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938329.422386:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59eeddb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2889a expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.422892:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:1.0:1784938329.422902:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938329.422990:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+42:2392:x1871643125300352:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 661us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938329.422999:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:0.0:1784938329.425023:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938329.425375:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125300608 00000100:00100000:3.0:1784938329.425388:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125300608 00000100:00100000:3.0:1784938329.425529:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:3.0:1784938329.425542:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+42:12273:x1871643125300608:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:3.0:1784938329.425907:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+43:12273:x1871643125300608:12345-192.168.203.26@tcp:35:cat.0 Request processed in 367us (898us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1784938329.425916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:0.0:1784938329.482471:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938329.482805:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125300864 00000100:00100000:3.0:1784938329.482821:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125300864 00000100:00100000:3.0:1784938329.482977:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 168 00000100:00100000:3.0:1784938329.482991:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+43:12279:x1871643125300864:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1784938329.483032:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938329.483037:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784938329.483080:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eed41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28870 expref: 43 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.483108:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:3.0:1784938329.483115:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938329.483133:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eede9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288a1 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.483349:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.483366:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28893 expref: 43 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.483376:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.483490:0:13805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28893 expref: 43 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.483509:0:13805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28893 expref: 43 pid: 9526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938329.483660:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144251008:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938329.483804:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc99596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938329.487181:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938329.487276:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125300992 00000100:00100000:2.0:1784938329.487288:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125300992 00010000:00010000:2.0:1784938329.487346:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28893 expref: 44 pid: 9526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938329.487405:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:2.0:1784938329.487418:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+44:2392:x1871643125300992:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938329.487448:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938329.487458:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28893 expref: 44 pid: 9526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.487474:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28893 expref: 44 pid: 9526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938329.487483:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144251008:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938329.487509:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eedbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28893 expref: 44 pid: 9526 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.487517:0:13805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.487532:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:2.0:1784938329.487539:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.487584:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.487593:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.490530:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938329.490742:0:13805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.490757:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938329.490786:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784938329.490973:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eede9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a1 expref: 45 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.490993:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a1 expref: 44 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938329.491001:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:3.0:1784938329.491003:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784938329.491006:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0000, rc 0) 00000100:00100000:2.0:1784938329.491363:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+44:2392:x1871643125300992:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 3943us (4192us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938329.491368:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+44:12279:x1871643125300864:12345-192.168.203.26@tcp:101:dd.0 Request processed in 8374us (8907us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1784938329.491380:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:3.0:1784938329.491386:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 168 00000100:00100000:1.0:1784938329.509820:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938329.510161:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125301120 00000100:00100000:2.0:1784938329.510175:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125301120 00000100:00100000:2.0:1784938329.510283:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:2.0:1784938329.510296:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+43:12279:x1871643125301120:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:2.0:1784938329.510330:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938329.510359:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedfe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288a8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.510403:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.510817:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.510835:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.511003:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eedfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a8 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.511043:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a8 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.512230:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:2.0:1784938329.512235:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938329.512241:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1a00, rc 0) 00000100:00100000:2.0:1784938329.512358:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+44:12279:x1871643125301120:12345-192.168.203.26@tcp:101:dd.0 Request processed in 2060us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938329.512370:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:0.0:1784938329.518460:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938329.518719:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125301376 00000100:00100000:1.0:1784938329.518735:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125301376 00000100:00100000:1.0:1784938329.518819:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 170 00000100:00100000:1.0:1784938329.518832:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+44:12279:x1871643125301376:12345-192.168.203.26@tcp:36:dd.0 00010000:00010000:1.0:1784938329.519163:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.519189:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.519203:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938329.519975:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1784938329.520041:0:9526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a45e6dd5 reply state 0000000013b5342e transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.520065:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938329.520077:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:1.0:1784938329.520100:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938329.520107:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938329.520322:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+47:12279:x1871643125301376:12345-192.168.203.26@tcp:36:dd.0 Request processed in 1488us (1872us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1784938329.520332:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 170 00000020:00080000:1.0:1784938329.520340:0:9526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784938329.695576:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938329.759675:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144251136:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938329.760147:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938329.760327:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144251136 00000100:00100000:3.0:1784938329.760359:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144251136 00000100:00100000:3.0:1784938329.760525:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 154 00000100:00100000:3.0:1784938329.760539:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144251136:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938329.760697:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938329.760777:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144251136:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 242us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938329.760787:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 154 00000100:00100000:2.0:1784938329.761493:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144251264:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938329.761698:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938329.761727:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144251264 00000100:00100000:2.0:1784938329.761733:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144251264 00000100:00100000:2.0:1784938329.761779:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 155 00000100:00100000:2.0:1784938329.761789:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144251264:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938329.761808:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784938329.761822:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144251136:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938329.761839:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144251264:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 51us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938329.761847:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 155 00000100:00100000:2.0:1784938329.761955:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144251264:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938329.909660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938329.913081:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125301504 00000100:00100000:3.0:1784938329.913104:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125301504 00000100:00100000:2.0:1784938329.913370:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:2.0:1784938329.913384:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+47:12293:x1871643125301504:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:2.0:1784938329.913460:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938329.913491:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eee13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288af expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913583:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913601:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913615:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913626:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913633:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913640:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913743:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913755:0:13805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a1 expref: 48 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913764:0:13805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913813:0:13805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a1 expref: 48 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.913831:0:13805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a1 expref: 48 pid: 13805 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938329.913844:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910d01908700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144251392:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938329.914001:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938329.919276:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938329.919649:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125301760 00000100:00100000:3.0:1784938329.919659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125301760 00000100:00100000:2.0:1784938329.919716:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910d01908700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13805:1871643144251392:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938329.919747:0:13805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938329.919782:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:3.0:1784938329.919794:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+49:6164:x1871643125301760:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784938329.920034:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+50:6164:x1871643125301760:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 242us (768us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1784938329.920041:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:1.0:1784938329.927725:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938329.927996:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125301888 00000100:00100000:0.0:1784938329.928012:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125301888 00010000:00010000:0.0:1784938329.928081:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a1 expref: 50 pid: 13805 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938329.928134:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:0.0:1784938329.928144:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+50:2394:x1871643125301888:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938329.928168:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938329.928180:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a1 expref: 50 pid: 13805 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938329.928204:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a1 expref: 50 pid: 13805 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938329.928259:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59eedf0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a1 expref: 50 pid: 13805 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938329.928277:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938329.928297:0:9518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938329.928319:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938329.928327:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938329.928368:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938329.928445:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+49:2394:x1871643125301888:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 302us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938329.928452:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 86 00010000:00010000:2.0:1784938329.928454:0:13805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928462:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938329.928519:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784938329.928525:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938329.928547:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928559:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928568:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928574:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928592:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928598:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938329.928602:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928610:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928619:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938329.928622:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938329.928625:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928632:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928644:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928651:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928657:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928661:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938329.928664:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928680:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928691:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc73b3800) 00010000:00010000:2.0:1784938329.928693:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938329.928696:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928713:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928745:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59eee13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288af expref: 49 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928758:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288af expref: 48 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938329.928765:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:2.0:1784938329.928768:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938329.928770:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0c00, rc 0) 00000100:00100000:2.0:1784938329.928799:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+48:12293:x1871643125301504:12345-192.168.203.26@tcp:101:stat.0 Request processed in 15418us (19156us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938329.928805:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:2.0:1784938330.040961:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938330.044702:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125302144 00000100:00100000:3.0:1784938330.044727:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125302144 00000100:00100000:3.0:1784938330.044931:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 172 00000100:00100000:3.0:1784938330.044950:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+48:12299:x1871643125302144:12345-192.168.203.26@tcp:36:truncate.0 00010000:00010000:3.0:1784938330.045040:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938330.045081:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59eee28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288af expref: 48 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.045111:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:3.0:1784938330.045118:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938330.045448:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.045466:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.045478:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938330.045532:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1784938330.045558:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059b47545 reply state 0000000050303cd0 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.045572:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.045579:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:3.0:1784938330.045583:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938330.045585:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938330.045718:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+50:12299:x1871643125302144:12345-192.168.203.26@tcp:36:truncate.0 Request processed in 775us (4773us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1784938330.045727:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 172 00000020:00080000:3.0:1784938330.045733:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1784938330.049908:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938330.234939:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938330.235066:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125302272 00000100:00100000:0.0:1784938330.235078:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125302272 00000100:00100000:0.0:1784938330.235156:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 173 00000100:00100000:0.0:1784938330.235168:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+50:12313:x1871643125302272:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:0.0:1784938330.235203:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938330.235264:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288b6 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235349:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235368:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235382:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235395:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235433:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235441:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235536:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235560:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235569:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938330.235624:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1784938330.235629:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938330.235661:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235674:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235684:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235690:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235696:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235713:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.235718:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235726:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235740:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938330.235743:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.235750:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235755:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eee3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235772:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235777:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235782:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235787:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.235789:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235794:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235812:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc73b3800) 00010000:00010000:0.0:1784938330.235814:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.235830:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235835:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eee44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235865:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288b6 expref: 52 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235878:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288b6 expref: 51 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.235886:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938330.235889:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938330.235891:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76000, rc 0) 00000100:00100000:0.0:1784938330.235982:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+51:12313:x1871643125302272:12345-192.168.203.26@tcp:101:stat.0 Request processed in 816us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938330.235990:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 173 00000100:00100000:1.0:1784938330.367956:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938330.368078:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125302528 00000100:00100000:2.0:1784938330.368091:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125302528 00000100:00100000:2.0:1784938330.368187:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 174 00000100:00100000:2.0:1784938330.368262:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+51:12323:x1871643125302528:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938330.368293:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938330.368319:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288bd expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938330.368471:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784938330.368617:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288bd expref: 53 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.368637:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19a00) 00010000:00010000:2.0:1784938330.368640:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938330.368648:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288bd expref: 53 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.368668:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1e00, rc 0) 00000100:00100000:2.0:1784938330.368756:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+52:12323:x1871643125302528:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 540us (815us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1784938330.368764:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 174 00000100:00100000:2.0:1784938330.371688:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938330.376299:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125302784 00000100:00100000:0.0:1784938330.376325:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125302784 00000100:00100000:0.0:1784938330.376557:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:0.0:1784938330.376573:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+52:12323:x1871643125302784:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:0.0:1784938330.376931:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+53:12323:x1871643125302784:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 361us (5254us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1784938330.376941:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:1.0:1784938330.453026:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938330.453180:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125303040 00000100:00100000:2.0:1784938330.453194:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125303040 00000100:00100000:2.0:1784938330.453316:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 175 00000100:00100000:2.0:1784938330.453329:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+53:12329:x1871643125303040:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1784938330.453365:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938330.453395:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee60 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288c4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.453605:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.453623:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288b6 expref: 54 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.453633:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.453678:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288b6 expref: 54 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.453694:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288b6 expref: 54 pid: 9526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938330.453710:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cc875fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144251520:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938330.453946:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938330.472921:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938330.473262:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125303168 00000100:00100000:0.0:1784938330.473276:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125303168 00010000:00010000:0.0:1784938330.473336:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288b6 expref: 55 pid: 9526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938330.473394:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:0.0:1784938330.473404:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+55:2392:x1871643125303168:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938330.473438:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938330.473447:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288b6 expref: 55 pid: 9526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.473465:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288b6 expref: 55 pid: 9526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.473496:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938330.473502:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.473516:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.473526:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.473552:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938330.473643:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+55:2392:x1871643125303168:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 239us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938330.473653:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 87 00010000:00010000:2.0:1784938330.474844:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59eee4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288b6 expref: 54 pid: 9526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938330.474874:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cc875fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1871643144251520:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938330.474906:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.474918:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.474967:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938330.474995:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1784938330.475211:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eee60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288c4 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.475311:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288c4 expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.475322:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:2.0:1784938330.475327:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938330.475331:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1800, rc 0) 00000100:00100000:2.0:1784938330.476836:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:12329:x1871643125303040:12345-192.168.203.26@tcp:101:bash.0 Request processed in 23496us (23810us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1784938330.476852:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 175 00000100:00100000:1.0:1784938330.494965:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938330.495481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125303424 00000100:00100000:3.0:1784938330.495497:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125303424 00000001:00080000:1.0:1784938330.495559:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000100:00100000:3.0:1784938330.495583:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 176 00000100:00100000:3.0:1784938330.495596:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+48:12329:x1871643125303424:12345-192.168.203.26@tcp:36:bash.0 00000004:00080000:1.0:1784938330.495623:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1784938330.495653:0:6492:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910cc9959240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1784938330.495658:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cc3bd9500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910cc99599c0 00000020:00080000:1.0:1784938330.495662:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cc3bd9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910bc7e08400 00010000:00010000:0.0:1784938330.495963:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.495990:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496004:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496015:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.496017:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496023:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.496029:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496042:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.496046:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496062:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff910bc1795400) 00010000:00010000:0.0:1784938330.496067:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.496073:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496081:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59eecc3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938330.496109:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00010000:00010000:0.0:1784938330.496110:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496120:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496127:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496132:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc1b054f0) 00000004:00010000:3.0:1784938330.496140:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f52e85b4 reply state 00000000b09e2db8 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496143:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496163:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.496169:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496176:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:3.0:1784938330.496178:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938330.496181:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938330.496183:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.496186:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938330.496189:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938330.496197:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eecca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496266:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496274:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496280:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496286:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.496289:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496295:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496303:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc73b3800) 00010000:00010000:0.0:1784938330.496306:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.496317:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496324:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eed09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938330.496339:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:12329:x1871643125303424:12345-192.168.203.26@tcp:36:bash.0 Request processed in 744us (1388us total) trans 4294967451 rc 0/0 00010000:00010000:0.0:1784938330.496344:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938330.496350:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 176 00010000:00010000:0.0:1784938330.496358:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784938330.496359:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784938330.496367:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496372:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.496376:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496382:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496391:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938330.496393:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.496396:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496402:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eee0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496426:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496432:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496445:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496450:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.496453:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496460:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496470:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938330.496473:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.496476:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.496482:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eee2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784938330.496505:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1784938330.496549:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1784938330.496655:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144251648:192.168.203.126@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938330.497017:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938330.497183:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144251648 00000100:00100000:2.0:1784938330.497193:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144251648 00000100:00100000:2.0:1784938330.497277:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:2.0:1784938330.497288:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144251648:12345-192.168.203.126@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938330.497322:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1784938330.497362:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a63ff58, atime: 0x6a63ff58, ctime: 0x6a63ff58, blocks: 0x8 00010000:00010000:2.0:1784938330.497370:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.497403:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1784938330.497408:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938330.497427:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.497446:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.497457:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.497465:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.497486:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938330.497686:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1871643144251648:12345-192.168.203.126@tcp:6:osp-syn-0-0.0 Request processed in 398us (669us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784938330.497694:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 58 00010000:00010000:0.0:1784938330.497722:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938330.497732:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.497743:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938330.497748:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.497760:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.497788:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.497796:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc8380d/0x26783cd1c59eee7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.497821:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938330.497824:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938330.497826:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938330.498018:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910cffb56d80/2, rc 0, transno 4294967308 00000100:00100000:2.0:1784938330.498028:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144251648:192.168.203.126@tcp:6:osp-syn-0-0.0 00000100:00080000:3.0:1784938330.498250:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938330.508752:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938330.508890:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125303552 00000100:00100000:3.0:1784938330.508903:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125303552 00000100:00100000:3.0:1784938330.508980:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:3.0:1784938330.508991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:12329:x1871643125303552:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1784938330.509032:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938330.509058:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59eee83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.509175:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.509209:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288c4 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.509264:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.509312:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288c4 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.509328:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288c4 expref: 21 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938330.509344:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144251776:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938330.510371:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9959540 going to sleep for 11 seconds 00000100:00100000:0.0:1784938330.513877:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938330.513981:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125303680 00000100:00100000:3.0:1784938330.514123:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125303680 00010000:00010000:3.0:1784938330.514186:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288c4 expref: 22 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938330.514318:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:3.0:1784938330.514330:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:2393:x1871643125303680:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938330.514352:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938330.514361:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288c4 expref: 22 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.514376:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288c4 expref: 22 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.514445:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:3.0:1784938330.514452:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.514464:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.514474:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.514499:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938330.514598:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:2393:x1871643125303680:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 270us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938330.514607:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 88 00010000:00010000:2.0:1784938330.515523:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288c4 expref: 21 pid: 6513 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938330.515560:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144251776:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938330.515615:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.515628:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.515635:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938330.515712:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784938330.515718:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938330.515744:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.515787:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59eee83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288cb expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.515806:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288cb expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.515816:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:2.0:1784938330.515819:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938330.515822:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1400, rc 0) 00000100:00100000:2.0:1784938330.515905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:12329:x1871643125303552:12345-192.168.203.26@tcp:101:bash.0 Request processed in 6914us (7164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938330.515913:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:0.0:1784938330.519938:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938330.520057:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125303936 00000100:00100000:3.0:1784938330.520071:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125303936 00000100:00100000:3.0:1784938330.520184:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:3.0:1784938330.520197:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:12329:x1871643125303936:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:3.0:1784938330.520580:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:12329:x1871643125303936:12345-192.168.203.26@tcp:35:bash.0 Request processed in 384us (656us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1784938330.520599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:1.0:1784938330.613659:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938330.613894:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125304192 00000100:00100000:2.0:1784938330.613908:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125304192 00000100:00100000:2.0:1784938330.613994:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 178 00000100:00100000:2.0:1784938330.614007:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:12339:x1871643125304192:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938330.614072:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938330.614102:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938330.614285:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784938330.614411:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288d2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.614444:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19a00) 00010000:00010000:2.0:1784938330.614448:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938330.614454:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eee91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288d2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.614473:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1800, rc 0) 00000100:00100000:2.0:1784938330.614562:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:12339:x1871643125304192:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 558us (918us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1784938330.614570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 178 00000100:00100000:1.0:1784938330.618156:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938330.618331:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125304320 00000100:00100000:2.0:1784938330.618345:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125304320 00000100:00100000:0.0:1784938330.618525:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:0.0:1784938330.618541:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:12339:x1871643125304320:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:0.0:1784938330.618664:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618686:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618700:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618717:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618724:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618754:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618856:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618866:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618873:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938330.618937:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618951:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618958:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618965:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618972:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.618977:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618986:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.618999:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938330.619008:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.619015:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619021:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eee9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619197:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619203:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619209:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619258:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.619261:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619266:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619274:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc1795400) 00010000:00010000:0.0:1784938330.619276:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.619279:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619285:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeea6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619300:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619311:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619317:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619321:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.619323:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619329:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619336:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938330.619338:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.619341:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.619347:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eeead lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938330.619849:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:12339:x1871643125304320:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 1307us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938330.619860:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:0.0:1784938330.622478:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938330.622648:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125304576 00000100:00100000:1.0:1784938330.622662:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125304576 00000100:00100000:1.0:1784938330.622738:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:1.0:1784938330.622750:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:12339:x1871643125304576:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938330.623073:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:12339:x1871643125304576:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 325us (610us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1784938330.623103:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:1.0:1784938330.657250:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938330.658940:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125304832 00000100:00100000:2.0:1784938330.659094:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125304832 00000100:00100000:2.0:1784938330.659204:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:2.0:1784938330.659258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:12342:x1871643125304832:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938330.659295:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938330.659327:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eeeb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659470:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659488:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659502:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659518:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659525:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659532:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659701:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eeec9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659713:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eeec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659722:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eeec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938330.659736:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784938330.659843:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659852:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659867:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659874:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938330.659879:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659888:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659903:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938330.659907:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938330.659913:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659920:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1800/0x26783cd1c59eeebb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659939:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659945:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659951:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659971:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938330.659975:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.659993:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.660003:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc73b3100) 00010000:00010000:2.0:1784938330.660006:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938330.660009:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.660015:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1e00/0x26783cd1c59eeec2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.660076:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eeeb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288d9 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.660093:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eeec9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288d9 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.660102:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:2.0:1784938330.660104:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938330.660107:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0800, rc 0) 00000100:00100000:2.0:1784938330.660270:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12342:x1871643125304832:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1000us (3002us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1784938330.660280:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:2.0:1784938330.665166:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938330.665362:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125304960 00000100:00100000:3.0:1784938330.665374:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125304960 00000100:00100000:3.0:1784938330.665465:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:3.0:1784938330.665478:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cc875fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12342:x1871643125304960:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1784938330.665577:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.665786:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.665801:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.665850:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.665857:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.665865:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.665872:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938330.665878:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.665886:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.665901:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:3.0:1784938330.665904:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938330.665910:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.665917:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eeed7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938330.666160:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cc875fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12342:x1871643125304960:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 682us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938330.666178:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:0.0:1784938330.670012:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938330.673350:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938330.673524:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125305344 00000100:00100000:0.0:1784938330.673538:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125305344 00000100:00100000:0.0:1784938330.673727:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:0.0:1784938330.673741:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12342:x1871643125305344:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938330.673849:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125305088 00000100:00100000:1.0:1784938330.673855:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125305088 00000100:00100000:1.0:1784938330.673908:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:1.0:1784938330.673915:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:2395:x1871643125305088:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938330.673928:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938330.673958:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0800/0x26783cd1c59eeec9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288d9 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938330.673982:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:1.0:1784938330.673988:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938330.674123:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:12342:x1871643125305344:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 383us (785us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1784938330.674131:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:1.0:1784938330.675855:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:2395:x1871643125305088:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1924us (5841us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938330.675872:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00010000:00010000:2.0:1784938330.722363:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938330.784792:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938330.784833:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144251904:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938330.785335:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938330.785548:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144251904 00000100:00100000:3.0:1784938330.785562:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144251904 00000100:00100000:3.0:1784938330.785642:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 205 00000100:00100000:3.0:1784938330.785662:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144251904:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938330.785717:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784938330.785780:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144251904:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 120us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938330.785788:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 205 00000100:00100000:3.0:1784938330.786199:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7dc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144251904:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938330.836873:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938330.836965:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125305600 00000100:00100000:0.0:1784938330.836979:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125305600 00000100:00100000:0.0:1784938330.837057:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:0.0:1784938330.837078:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12360:x1871643125305600:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:0.0:1784938330.837121:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938330.837159:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eeede lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288e0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.837368:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeee5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.837401:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeee5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.837423:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeee5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938330.837438:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784938330.837841:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eeede lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288e0 expref: 28 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.837872:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeee5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288e0 expref: 27 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.837917:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938330.837921:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784938330.837926:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76e00, rc 0) 00000100:00100000:0.0:1784938330.838269:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12360:x1871643125305600:12345-192.168.203.26@tcp:101:cat.0 Request processed in 1200us (1406us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1784938330.838279:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:0.0:1784938330.892965:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938330.893275:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125305728 00000100:00100000:2.0:1784938330.893290:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125305728 00000100:00100000:2.0:1784938330.893399:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:2.0:1784938330.893422:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12361:x1871643125305728:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938330.893458:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938330.893487:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59eeef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288e7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.893580:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59eeefa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.893599:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59eeefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.893615:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59eeefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938330.893688:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784938330.893692:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938330.893717:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59eeefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.893752:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59eeef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288e7 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.893775:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59eeefa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288e7 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938330.893786:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938330.893789:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938330.893794:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0000, rc 0) 00000100:00100000:2.0:1784938330.893895:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12361:x1871643125305728:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 485us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938330.893912:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:2.0:1784938330.905418:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938330.905584:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125306112 00000100:00100000:3.0:1784938330.905596:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125306112 00000100:00100000:3.0:1784938330.905746:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1784938330.905761:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12361:x1871643125306112:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1784938330.906268:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:12361:x1871643125306112:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 506us (882us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1784938330.906277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:1.0:1784938330.914125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938330.915542:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125306240 00000100:00100000:3.0:1784938330.915560:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125306240 00000100:00100000:0.0:1784938330.915721:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:0.0:1784938330.915738:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:12361:x1871643125306240:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:0.0:1784938330.915763:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784938330.915806:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eee8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288cb expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.915839:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eeee5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288e0 expref: 28 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.915855:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eed80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28885 expref: 27 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.915867:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938330.915874:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938330.916140:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:12361:x1871643125306240:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 406us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938330.916149:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:1.0:1784938330.919880:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938330.923609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125306368 00000100:00100000:3.0:1784938330.923634:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125306368 00000100:00100000:3.0:1784938330.923924:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:3.0:1784938330.923938:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:12361:x1871643125306368:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:3.0:1784938330.924142:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.924166:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938330.924180:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938330.924489:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1784938330.924627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:12361:x1871643125306368:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 691us (4760us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938330.924636:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:2.0:1784938330.952773:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938330.954591:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125306496 00000100:00100000:0.0:1784938330.954641:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125306496 00000100:00100000:0.0:1784938330.954754:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:0.0:1784938330.954766:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:12363:x1871643125306496:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938330.954798:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938330.954830:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eef08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288ee expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.954920:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.954938:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.954950:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.954965:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.954972:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.954977:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955077:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955086:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955093:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938330.955155:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784938330.955159:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938330.955181:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955195:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955204:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955210:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955266:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955273:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.955278:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955286:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955300:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938330.955303:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.955310:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955316:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955343:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955349:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955354:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955359:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938330.955362:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955368:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955376:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc1795400) 00010000:00010000:0.0:1784938330.955378:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938330.955381:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955386:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955441:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59eef08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288ee expref: 28 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955459:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288ee expref: 27 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938330.955479:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938330.955482:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938330.955486:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76c00, rc 0) 00000100:00100000:1.0:1784938330.961300:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12363:x1871643125306496:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 6516us (8526us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938330.961315:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 185 00000040:00080000:2.0:1784938331.615691:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938331.615710:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784938331.615767:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1784938331.615776:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938331.615970:0:13794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb15880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144252032:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784938331.616740:0:13794:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938331.620706:0:13794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb15880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144252032:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784938331.623117:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.623429:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125306624 00000100:00100000:3.0:1784938331.623442:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125306624 00000100:00100000:3.0:1784938331.623517:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:3.0:1784938331.623529:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12374:x1871643125306624:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784938331.623574:0:13805:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784938331.623731:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12374:x1871643125306624:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 204us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938331.623740:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:2.0:1784938331.626493:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.626742:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125306752 00000100:00100000:3.0:1784938331.626757:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125306752 00000100:00100000:3.0:1784938331.626841:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:3.0:1784938331.626852:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12374:x1871643125306752:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784938331.626964:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627002:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627022:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627043:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627051:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627058:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627097:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627106:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627114:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938331.627176:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784938331.627182:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938331.627200:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627248:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627267:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627274:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627281:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938331.627287:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627296:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627312:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:3.0:1784938331.627315:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938331.627321:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627328:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627341:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627346:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627351:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627356:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938331.627365:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627371:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627378:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff910cc2a19400) 00010000:00010000:3.0:1784938331.627380:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938331.627383:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627389:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59eef2b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627418:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627425:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627431:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627435:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938331.627438:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627444:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627451:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:3.0:1784938331.627453:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938331.627462:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.627469:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eef32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938331.627571:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12374:x1871643125306752:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 718us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938331.627579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:3.0:1784938331.629921:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938331.630004:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125307008 00000100:00100000:1.0:1784938331.630017:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125307008 00000100:00100000:1.0:1784938331.630096:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:1.0:1784938331.630108:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12374:x1871643125307008:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938331.630153:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938331.630179:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288f5 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.630357:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.630375:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.630388:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938331.630401:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784938331.631179:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.631197:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.631206:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.631305:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938331.631313:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.631324:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.631346:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:1.0:1784938331.631367:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938331.631376:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.631383:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.631612:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef39 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288f5 expref: 29 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.631630:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:1.0:1784938331.631632:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938331.631637:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288f5 expref: 29 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.631648:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1e00, rc 0) 00000100:00100000:1.0:1784938331.631849:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12374:x1871643125307008:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1742us (2326us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1784938331.631859:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:1.0:1784938331.637553:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.637716:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125307136 00000100:00100000:3.0:1784938331.637732:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125307136 00000100:00100000:3.0:1784938331.637830:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:3.0:1784938331.637842:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12374:x1871643125307136:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784938331.637902:0:6513:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784938331.638334:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12374:x1871643125307136:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 229us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938331.638343:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:3.0:1784938331.641353:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938331.643439:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125307392 00000100:00100000:0.0:1784938331.643463:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125307392 00000100:00100000:0.0:1784938331.643556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:0.0:1784938331.643573:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12374:x1871643125307392:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938331.643605:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938331.643609:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784938331.643647:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59eeefa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288e7 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.643668:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938331.643679:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938331.643703:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef4e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a288fc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938331.644258:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1784938331.644468:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.644485:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.644498:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.644578:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef4e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288fc expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.644596:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288fc expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.644606:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795a00) 00010000:00010000:0.0:1784938331.644609:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938331.644612:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76e00, rc 0) 00000100:00100000:0.0:1784938331.644701:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:12374:x1871643125307392:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1134us (3367us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1784938331.644709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:3.0:1784938331.652890:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938331.653171:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125307648 00000100:00100000:1.0:1784938331.653185:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125307648 00000100:00100000:1.0:1784938331.653278:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:1.0:1784938331.653290:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:12374:x1871643125307648:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784938331.653373:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938331.653473:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59eef55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288fc expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.653514:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795a00) 00010000:00010000:1.0:1784938331.653660:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938331.653700:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.653719:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.653732:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658665:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658695:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658710:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658776:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658783:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658790:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658797:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938331.658802:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658827:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658842:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938331.658845:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938331.658850:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658856:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eef63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658875:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658882:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658889:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658894:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938331.658896:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658902:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658909:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x1995b7e2 (ffff910bc65fc400) 00010000:00010000:1.0:1784938331.658912:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938331.658915:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.658932:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef6a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1995b7e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.659053:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12374:x1871643125307648:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 5760us (6171us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938331.659064:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:0.0:1784938331.664543:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938331.664591:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125307776 00000100:00100000:0.0:1784938331.664604:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125307776 00000100:00100000:0.0:1784938331.664674:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:0.0:1784938331.664685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12374:x1871643125307776:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938331.664724:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938331.664756:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28903 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.664806:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.664825:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.664861:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.665023:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59eef71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28903 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.665048:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28903 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.665057:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:0.0:1784938331.665060:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784938331.665065:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77a00, rc 0) 00000100:00100000:0.0:1784938331.665286:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:12374:x1871643125307776:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 602us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938331.665293:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:1.0:1784938331.676684:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.676867:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125308032 00000100:00100000:3.0:1784938331.676887:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125308032 00000100:00100000:3.0:1784938331.676967:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:3.0:1784938331.676978:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:12374:x1871643125308032:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784938331.677100:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.677123:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.677158:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938331.677824:0:13805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1784938331.677839:0:13805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399709623493ns, next at 400709620694ns, rc = 0 00000004:00010000:3.0:1784938331.677920:0:13805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c76bb40 reply state 00000000f0c83f6e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.677940:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.677949:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:3.0:1784938331.677953:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784938331.677958:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938331.678135:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+31:12374:x1871643125308032:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 1156us (1459us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1784938331.678145:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:0.0:1784938331.680895:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938331.680952:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125308160 00000100:00100000:1.0:1784938331.680966:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125308160 00000100:00100000:1.0:1784938331.681048:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:1.0:1784938331.681059:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+31:12374:x1871643125308160:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938331.681109:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938331.681146:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2890a expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.681280:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2890a expref: 32 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.681299:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2890a expref: 32 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.681323:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:1.0:1784938331.681328:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938331.681332:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d0c00, rc 0) 00000100:00100000:1.0:1784938331.681419:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:12374:x1871643125308160:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 362us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938331.681444:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:0.0:1784938331.684980:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938331.686097:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125308288 00000100:00100000:2.0:1784938331.686115:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125308288 00000100:00100000:2.0:1784938331.686210:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1784938331.686250:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+6:2392:x1871643125308288:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1784938331.686337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938331.686595:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125308288:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 350us (1629us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784938331.686604:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1784938331.694325:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938331.694893:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125308544 00000100:00100000:0.0:1784938331.694908:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125308544 00000100:00100000:0.0:1784938331.694994:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:0.0:1784938331.695006:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:12374:x1871643125308544:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784938331.695403:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:12374:x1871643125308544:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 398us (1093us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1784938331.695422:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:3.0:1784938331.698717:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938331.698834:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125308800 00000100:00100000:0.0:1784938331.698847:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125308800 00000100:00100000:0.0:1784938331.698942:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:0.0:1784938331.698954:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:12374:x1871643125308800:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784938331.699494:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:12374:x1871643125308800:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 541us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938331.699504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:2.0:1784938331.701288:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.701509:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125308928 00000100:00100000:3.0:1784938331.701520:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125308928 00000100:00100000:3.0:1784938331.702063:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:3.0:1784938331.702076:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+33:12374:x1871643125308928:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938331.702104:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938331.702134:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59eef8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28911 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.702278:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eef94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.702315:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eef94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.702330:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eef94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938331.702392:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938331.702436:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eef94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.702468:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59eef8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28911 expref: 35 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.702492:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eef94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28911 expref: 34 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.702501:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:3.0:1784938331.702504:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784938331.702509:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1a00, rc 0) 00000100:00100000:3.0:1784938331.702618:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:12374:x1871643125308928:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 543us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938331.702626:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:2.0:1784938331.705950:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938331.706334:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125309056 00000100:00100000:1.0:1784938331.706347:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125309056 00000100:00100000:1.0:1784938331.706474:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:1.0:1784938331.706488:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2395:x1871643125309056:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938331.706515:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938331.706546:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28918 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938331.706584:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63ff5b, blocks: 0x0 00010000:00010000:1.0:1784938331.706615:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1784938331.706621:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938331.706634:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28918 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.706656:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28918 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.706672:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1e00, rc 0) 00000100:00100000:1.0:1784938331.706889:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2395:x1871643125309056:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 403us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938331.706898:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:0.0:1784938331.712086:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.712245:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125309312 00000100:00100000:3.0:1784938331.712260:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125309312 00000100:00100000:3.0:1784938331.712351:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:3.0:1784938331.712364:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:12374:x1871643125309312:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784938331.712530:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:12374:x1871643125309312:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 168us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938331.712559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:0.0:1784938331.717420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938331.717538:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125309440 00000100:00100000:2.0:1784938331.717552:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125309440 00000100:00100000:2.0:1784938331.717629:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:2.0:1784938331.717641:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:12374:x1871643125309440:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938331.717690:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938331.717725:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2891f expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.717773:0:8770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28918 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.717784:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938331.717789:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938331.717795:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 9 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.717840:0:8770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28918 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.717859:0:8770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28918 expref: 9 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938331.717878:0:8770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1871643144252160:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938331.717995:0:8770:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938331.720857:0:8770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1871643144252160:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938331.720912:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 9 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.720942:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1200, rc 0) 00000100:00100000:2.0:1784938331.721041:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:12374:x1871643125309440:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 3401us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938331.721052:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:3.0:1784938331.721866:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938331.722175:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125309568 00000100:00100000:0.0:1784938331.722190:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125309568 00010000:00010000:0.0:1784938331.722292:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28918 expref: 9 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.722340:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:0.0:1784938331.722352:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125309568:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938331.722372:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938331.722403:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28918 expref: 9 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.722429:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28918 expref: 9 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.722459:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ebfcdc/0x26783cd1c59eef9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28918 expref: 9 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.722483:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938331.722490:0:7921:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938331.722526:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.722538:0:7921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.722589:0:7921:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.722607:0:7921:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd7dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7921:1871643144252288:192.168.203.26@tcp:105: 00000100:00100000:0.0:1784938331.722723:0:7921:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf863f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938331.725926:0:7921:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd7dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7921:1871643144252288:192.168.203.26@tcp:105: 00010000:00010000:1.0:1784938331.725971:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938331.726064:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2393:x1871643125309568:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 3713us (4202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938331.726098:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:1.0:1784938331.731784:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.732122:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125309696 00000100:00100000:3.0:1784938331.732139:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125309696 00002000:00100000:3.0:1784938331.732244:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff910bc7dc0000 x1871643125309696/t0(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:562/0 lens 504/0 e 0 to 0 dl 1784938342 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938331.732261:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc7dc0000 with x1871643125309696 ext(0->8) 00002000:00010000:3.0:1784938331.732269:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910bc7dc0000 00000100:00100000:0.0:1784938331.732354:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:0.0:1784938331.732372:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125309696:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784938331.738009:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:2392:x1871643125309696:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 5630us (6223us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1784938331.738024:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00002000:00100000:0.0:1784938331.738038:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff910bc7dc0000 x1871643125309696/t4294967315(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:562/0 lens 504/448 e 0 to 0 dl 1784938342 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938331.738047:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc7dc0000 with x1871643125309696 ext(0->8) 00002000:00010000:0.0:1784938331.738054:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910bc7dc0000 00000100:00100000:0.0:1784938331.740980:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938331.741096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125309824 00000100:00100000:2.0:1784938331.741107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125309824 00000100:00100000:2.0:1784938331.741174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:2.0:1784938331.741185:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:12374:x1871643125309824:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1784938331.743441:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784938331.746884:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1784938331.746912:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00010000:00010000:3.0:1784938331.746955:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784938331.746971:0:6492:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:3.0:1784938331.746977:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.746988:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.746996:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938331.747003:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747012:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747034:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:3.0:1784938331.747037:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938331.747043:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747049:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eee75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747108:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747115:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747122:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747127:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938331.747131:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747138:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747147:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:3.0:1784938331.747150:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784938331.747153:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.747159:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eef7f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938331.747288:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd7dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:12374:x1871643125309824:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 6096us (6309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938331.747302:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:1.0:1784938331.747511:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:0.0:1784938331.747524:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1784938331.747566:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1784938331.747618:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc76cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144252416:192.168.203.126@tcp:2:osp-syn-1-0.0 00000100:00100000:1.0:1784938331.747999:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938331.748030:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144252416 00000100:00100000:1.0:1784938331.748036:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144252416 00000100:00100000:1.0:1784938331.748083:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:1.0:1784938331.748091:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144252416:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 00002000:00010000:1.0:1784938331.748250:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784938331.748254:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784938331 00002000:00010000:1.0:1784938331.748256:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784938331.748258:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1784938331 -> 1784938331 00002000:00010000:1.0:1784938331.748261:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1784938331.748297:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144252416:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 Request processed in 205us (298us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1784938331.748305:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00080000:1.0:1784938331.748333:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1784938331.749920:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910bc76cd180/2, rc 0, transno 4294967316 00000100:00100000:1.0:1784938331.749937:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc76cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144252416:192.168.203.126@tcp:2:osp-syn-1-0.0 00000100:00100000:1.0:1784938331.760748:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.760951:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125309952 00000100:00100000:3.0:1784938331.760963:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125309952 00000100:00100000:3.0:1784938331.761034:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:3.0:1784938331.761048:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:2393:x1871643125309952:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1784938331.766472:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1784938331.766501:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1784938331.766917:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2393:x1871643125309952:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 5859us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938331.766959:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:1.0:1784938331.777486:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.777585:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125310208 00000100:00100000:3.0:1784938331.777595:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125310208 00000100:00100000:3.0:1784938331.777657:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:3.0:1784938331.777669:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:12374:x1871643125310208:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784938331.777723:0:9526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938331.777750:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eef94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28911 expref: 19 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.777769:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:3.0:1784938331.777775:0:9526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938331.777813:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.777827:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.777838:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938331.777964:0:9526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006cde132c reply state 00000000e0b42a40 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.777978:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.777985:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:3.0:1784938331.777988:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938331.778000:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938331.778104:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:12374:x1871643125310208:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 433us (622us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1784938331.778114:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:1.0:1784938331.784685:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.784933:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125310336 00000100:00100000:3.0:1784938331.784943:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125310336 00000100:00100000:3.0:1784938331.785022:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1784938331.785032:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125310336:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784938331.785191:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1784938331.785195:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1784938331 -> 1784938330 00002000:00010000:3.0:1784938331.785198:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784938328 00002000:00010000:3.0:1784938331.785200:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1784938331 -> 1784938330 00002000:00010000:3.0:1784938331.785202:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1784938331.785372:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125310336:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 340us (850us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1784938331.785380:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:1.0:1784938331.788851:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.788934:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125310592 00000100:00100000:3.0:1784938331.788945:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125310592 00000100:00100000:3.0:1784938331.789016:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:3.0:1784938331.789028:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:12374:x1871643125310592:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784938331.789102:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.789120:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28903 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.789129:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.789177:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28903 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.789191:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28903 expref: 20 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938331.789205:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144252544:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938331.789599:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc74539c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938331.799060:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938331.799145:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125310720 00000100:00100000:1.0:1784938331.799155:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125310720 00010000:00010000:1.0:1784938331.799199:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28903 expref: 21 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.799281:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:1.0:1784938331.799296:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:2392:x1871643125310720:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938331.799323:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938331.799332:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28903 expref: 21 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.799347:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28903 expref: 21 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.799369:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:1.0:1784938331.799375:0:9518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.799386:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.799393:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.799559:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938331.799617:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:2392:x1871643125310720:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 327us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938331.799625:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 90 00010000:00010000:3.0:1784938331.800922:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59eef78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28903 expref: 20 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938331.800951:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144252544:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938331.800977:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.801027:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.801047:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.801110:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.801118:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.801128:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.801135:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938331.801142:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.801151:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.801175:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:1.0:1784938331.801179:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784938331.801185:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.801192:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59eefb0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.811184:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:12374:x1871643125310592:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 22138us (22325us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784938331.811241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:2.0:1784938331.827561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938331.827661:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125310848 00000100:00100000:1.0:1784938331.827676:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125310848 00000100:00100000:1.0:1784938331.827752:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1784938331.827764:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125310848:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784938331.827831:0:8770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.827861:0:8770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.827871:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938331.827876:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938331.827881:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.827930:0:8770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.827947:0:8770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 8 pid: 8770 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.827965:0:8770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2076300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1871643144252672:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938331.828076:0:8770:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938331.832563:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938331.832615:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125310976 00000100:00100000:2.0:1784938331.832626:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125310976 00010000:00010000:2.0:1784938331.832684:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 9 pid: 8770 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938331.832747:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 91 00000100:00100000:2.0:1784938331.832765:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2392:x1871643125310976:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938331.832791:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938331.832825:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 9 pid: 8770 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.832862:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 9 pid: 8770 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.832912:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938331.832920:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938331.832930:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.832944:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.832977:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938331.833053:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2392:x1871643125310976:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 294us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938331.833064:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 91 00010000:00010000:1.0:1784938331.833709:0:8770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b7794e9/0x26783cd1c59eefa2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2891f expref: 8 pid: 8770 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.833747:0:8770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2076300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1871643144252672:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938331.833913:0:8770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.833930:0:8770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.833939:0:8770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.833973:0:8770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.833983:0:8770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.833994:0:8770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.834003:0:8770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938331.834010:0:8770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.834021:0:8770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.834052:0:8770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.834060:0:8770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000105c3f89/0x26783cd1c59eefb7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.834181:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125310848:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 6418us (6635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938331.834191:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1784938331.839980:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.840247:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125311232 00000100:00100000:3.0:1784938331.840264:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125311232 00000100:00100000:3.0:1784938331.840358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 201 00000100:00100000:3.0:1784938331.840369:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:12374:x1871643125311232:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784938331.840465:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.840484:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a8 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.840494:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.840543:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a8 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.840561:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a8 expref: 19 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938331.840577:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144252800:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938331.840674:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc74539c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938331.851700:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938331.854521:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125311360 00000100:00100000:1.0:1784938331.854550:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125311360 00010000:00010000:1.0:1784938331.854627:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a8 expref: 20 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.854704:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 92 00000100:00100000:1.0:1784938331.854720:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:2392:x1871643125311360:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938331.854745:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938331.854756:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a8 expref: 20 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.854789:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a8 expref: 20 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.854827:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:1.0:1784938331.854843:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.854856:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.854867:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.854906:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938331.854998:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:2392:x1871643125311360:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 284us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938331.855007:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 92 00010000:00010000:3.0:1784938331.858257:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1a00/0x26783cd1c59eee05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288a8 expref: 19 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938331.858295:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144252800:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938331.858329:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.858341:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.858347:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.858642:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.858661:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2890a expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.858671:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.858747:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2890a expref: 19 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.858879:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2890a expref: 19 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938331.858902:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144252928:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938331.859208:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7453180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938331.867840:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938331.872602:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125311488 00000100:00100000:0.0:1784938331.872635:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125311488 00010000:00010000:0.0:1784938331.872708:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2890a expref: 20 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.872787:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 93 00000100:00100000:0.0:1784938331.872800:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:2393:x1871643125311488:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938331.872825:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938331.872835:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2890a expref: 20 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.872853:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2890a expref: 20 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.872893:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:0.0:1784938331.872900:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.872913:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.872923:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.872956:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938331.873060:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:2393:x1871643125311488:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 263us (5236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938331.873069:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 93 00010000:00010000:3.0:1784938331.881447:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eef86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2890a expref: 19 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938331.881488:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144252928:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938331.881528:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.881542:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.881548:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938331.881736:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1784938331.882124:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1784938331.882170:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1784938331.882317:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1871643144253056:192.168.203.126@tcp:1000:mdt00_000.0 00000100:00100000:3.0:1784938331.882443:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910ccca5fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938331.882724:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938331.890116:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144253056 00000100:00100000:2.0:1784938331.890148:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144253056 00000100:00100000:2.0:1784938331.890518:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 206 00000100:00100000:2.0:1784938331.890532:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1871643144253056:12345-192.168.203.126@tcp:1000:mdt00_000.0 00000100:00100000:2.0:1784938331.890710:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1871643144253056:12345-192.168.203.126@tcp:1000:mdt00_000.0 Request processed in 182us (7987us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938331.890719:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 206 00000100:00100000:1.0:1784938331.894154:0:6512:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1784938331.894174:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910bc76cd180, transno 4294967316 00000100:00100000:1.0:1784938331.894202:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1871643144253056:192.168.203.126@tcp:1000:mdt00_000.0 00000001:00080000:1.0:1784938331.894543:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1784938331.894683:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2075180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1871643144253184:192.168.203.126@tcp:1000:mdt00_000.0 00000100:00100000:1.0:1784938331.894795:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc98c53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938331.895071:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938331.898641:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144253184 00000100:00100000:1.0:1784938331.898671:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144253184 00000100:00100000:1.0:1784938331.898788:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 207 00000100:00100000:1.0:1784938331.898803:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1871643144253184:12345-192.168.203.126@tcp:1000:mdt00_000.0 00000100:00100000:1.0:1784938331.899119:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc76cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1871643144253184:12345-192.168.203.126@tcp:1000:mdt00_000.0 Request processed in 318us (4046us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1784938331.899130:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 207 00000100:00100000:1.0:1784938331.899545:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2075180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1871643144253184:192.168.203.126@tcp:1000:mdt00_000.0 00010000:00010000:1.0:1784938331.899629:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899642:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899651:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899658:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938331.899664:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899673:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899694:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:1.0:1784938331.899697:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938331.899703:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899709:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1400/0x26783cd1c59eefc5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899752:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899758:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899763:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899778:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938331.899781:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899787:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899796:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:1.0:1784938331.899799:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938331.899802:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899807:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59eef01 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899835:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899849:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288ee expref: 22 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899859:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899907:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288ee expref: 22 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.899928:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288ee expref: 22 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.899964:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144253312:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938331.900061:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938331.903349:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144253312:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938331.903399:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.906885:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938331.906937:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125311616 00000100:00100000:3.0:1784938331.906949:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125311616 00010000:00010000:3.0:1784938331.907064:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288ee expref: 23 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938331.907118:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:3.0:1784938331.907132:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:2392:x1871643125311616:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938331.907151:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938331.907159:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288ee expref: 23 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.907237:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288ee expref: 23 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.907270:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59eef1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a288ee expref: 23 pid: 9526 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.907287:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:3.0:1784938331.907294:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.907303:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.908076:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.908196:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938331.908300:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:2392:x1871643125311616:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1167us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938331.908309:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 94 00010000:00010000:0.0:1784938331.909579:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.909604:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.909617:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.909624:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.909632:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.909638:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938331.909642:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.909650:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.909665:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938331.909669:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938331.909673:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.909970:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefcc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.910110:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.910118:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.910131:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.910137:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938331.910140:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.910148:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.910157:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1795900) 00010000:00010000:0.0:1784938331.910160:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784938331.910163:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.910169:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59eefbe lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.910582:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:12374:x1871643125311232:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 70211us (70614us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1784938331.910592:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 201 00000020:00080000:0.0:1784938331.910597:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1784938331.912869:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000040:00080000:0.0:1784938331.913192:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938331.913197:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1784938331.913939:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125311872 00000040:00080000:0.0:1784938331.913968:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000100:00100000:2.0:1784938331.913972:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125311872 00000040:00080000:0.0:1784938331.913988:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938331.914070:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:2.0:1784938331.914085:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:12374:x1871643125311872:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784938331.914715:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784938331.914844:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1784938331.914900:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.914926:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.914942:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.914954:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.914962:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.914970:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.915010:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938331.915157:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:12374:x1871643125311872:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 1072us (2293us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1784938331.915168:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000020:00080000:2.0:1784938331.915176:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784938331.915791:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938331.915804:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.915814:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938331.915820:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.915830:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.915847:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:1.0:1784938331.915851:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938331.915858:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.915865:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1600/0x26783cd1c59eefd3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.915880:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938331.915882:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938331.915884:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784938331.964705:0:14655:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938331.964720:0:14655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938331.964752:0:14655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784938331.966332:0:14655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938332.093845:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.093992:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125312128 00000100:00100000:1.0:1784938332.094002:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125312128 00000100:00080000:3.0:1784938332.094125:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938332.095043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00100000:1.0:1784938332.095059:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:12384:x1871643125312128:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938332.095091:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938332.095112:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eefda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28926 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.095233:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefe1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.095249:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.095261:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefe1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938332.095272:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1784938332.095373:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59eefda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28926 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.095392:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefe1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28926 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.095412:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938332.095415:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784938332.095418:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1600, rc 0) 00000100:00100000:1.0:1784938332.095480:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12384:x1871643125312128:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 426us (1644us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1784938332.095487:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00100000:0.0:1784938332.106517:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.106996:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125312256 00000100:00100000:1.0:1784938332.107005:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125312256 00000100:00100000:1.0:1784938332.107057:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 203 00000100:00100000:1.0:1784938332.107070:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12384:x1871643125312256:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1784938332.107153:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107170:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107182:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107195:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107202:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107375:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107459:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107468:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107474:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938332.107518:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107530:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107543:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107549:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107555:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.107558:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107566:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107577:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938332.107579:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.107584:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107589:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59eefef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107601:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107606:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107610:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107614:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.107623:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107629:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107635:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc400) 00010000:00010000:1.0:1784938332.107637:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.107640:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107645:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59eeff6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107660:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107665:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107670:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107675:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.107678:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107684:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107691:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc65fc700) 00010000:00010000:1.0:1784938332.107693:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.107701:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.107708:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59eeffd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938332.107792:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12384:x1871643125312256:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 722us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.107799:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 203 00000100:00100000:1.0:1784938332.208426:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938332.208533:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125312512 00000100:00100000:0.0:1784938332.208543:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125312512 00000100:00100000:0.0:1784938332.208655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:0.0:1784938332.208666:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+25:12387:x1871643125312512:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938332.208688:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938332.208708:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef004 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2892d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.208780:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.208795:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.208806:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.208819:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.208827:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.208833:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.208948:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.208957:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.208991:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938332.209002:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1784938332.209094:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209102:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209108:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209114:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938332.209118:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209125:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209137:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938332.209140:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938332.209145:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209151:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef00b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209164:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209170:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209183:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209188:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938332.209191:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209197:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209204:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc1799300) 00010000:00010000:0.0:1784938332.209207:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938332.209210:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209260:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209307:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef004 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2892d expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209321:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2892d expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.209328:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:0.0:1784938332.209330:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938332.209332:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77a00, rc 0) 00000100:00100000:0.0:1784938332.209395:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12387:x1871643125312512:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 730us (979us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1784938332.209421:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:3.0:1784938332.216386:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.216488:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125312640 00000100:00100000:1.0:1784938332.216503:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125312640 00000100:00100000:1.0:1784938332.216581:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:1.0:1784938332.216591:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12387:x1871643125312640:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1784938332.216658:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.216676:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.216688:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.216722:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.216729:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.216736:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.216759:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.216764:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.216771:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.216783:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:1.0:1784938332.216786:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938332.216792:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.216797:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef027 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938332.216882:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12387:x1871643125312640:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 292us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.216891:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:0.0:1784938332.221173:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.221355:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125312896 00000100:00100000:1.0:1784938332.221372:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125312896 00000100:00100000:1.0:1784938332.221484:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:1.0:1784938332.221495:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12387:x1871643125312896:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938332.221717:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12387:x1871643125312896:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 223us (559us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1784938332.221725:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:3.0:1784938332.299626:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938332.300035:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125313152 00000100:00100000:0.0:1784938332.300050:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125313152 00000100:00100000:0.0:1784938332.300322:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 206 00000100:00100000:0.0:1784938332.300335:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:11919:x1871643125313152:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1784938332.300373:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938332.300417:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef02e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28934 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.300572:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.300589:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2892d expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.300599:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.300642:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2892d expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.300659:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2892d expref: 29 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938332.300674:0:9526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1871643144253440:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938332.300802:0:9526:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf863f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938332.305748:0:9526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1871643144253440:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938332.305796:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938332.306247:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.306363:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125313280 00000100:00100000:1.0:1784938332.306376:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125313280 00010000:00010000:1.0:1784938332.306463:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2892d expref: 30 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938332.306800:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:1.0:1784938332.306813:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:2393:x1871643125313280:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938332.306836:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938332.306845:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2892d expref: 30 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.306859:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2892d expref: 30 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.306889:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef019 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2892d expref: 30 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.306912:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:1.0:1784938332.306919:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.306930:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.306940:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.306982:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938332.307061:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938332.307078:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:2393:x1871643125313280:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 263us (869us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938332.307079:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938332.307102:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 95 00000004:00200000:3.0:1784938332.307116:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784938332.307282:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef02e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28934 expref: 30 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938332.307304:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28934 expref: 29 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938332.307313:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:3.0:1784938332.307316:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784938332.307319:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77e00, rc 0) 00000100:00100000:3.0:1784938332.307368:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:11919:x1871643125313152:12345-192.168.203.26@tcp:101:bash.0 Request processed in 7036us (7756us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1784938332.307376:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 206 00000100:00100000:3.0:1784938332.317564:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938332.317723:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125313408 00000100:00100000:0.0:1784938332.317744:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125313408 00000100:00100000:0.0:1784938332.317836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00100000:0.0:1784938332.317849:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:11919:x1871643125313408:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1784938332.317886:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938332.317919:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef043 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2893b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.317971:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef04a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.317990:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.318004:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef04a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.318160:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef043 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2893b expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.318184:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef04a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2893b expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.318194:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:0.0:1784938332.318198:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784938332.318211:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76e00, rc 0) 00000100:00100000:0.0:1784938332.318357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:11919:x1871643125313408:12345-192.168.203.26@tcp:101:bash.0 Request processed in 511us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938332.318365:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00100000:1.0:1784938332.319823:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144253568:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938332.321151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938332.321447:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144253568 00000100:00100000:0.0:1784938332.321466:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144253568 00000100:00100000:0.0:1784938332.321545:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 208 00000100:00100000:0.0:1784938332.321557:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144253568:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938332.321612:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938332.321712:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144253568:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 145us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938332.321723:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 208 00000100:00100000:2.0:1784938332.327061:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.327152:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125313664 00000100:00100000:1.0:1784938332.327172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125313664 00000100:00100000:1.0:1784938332.327303:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 208 00000100:00100000:1.0:1784938332.327316:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:11919:x1871643125313664:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:1.0:1784938332.327720:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.327747:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.327763:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938332.327824:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1784938332.327852:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015dcc2a9 reply state 00000000e65d4e5a transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.327866:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.327875:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:1.0:1784938332.327879:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938332.327884:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784938332.327965:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1784938332.328260:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144253568:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938332.330234:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfb2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:11919:x1871643125313664:12345-192.168.203.26@tcp:36:bash.0 Request processed in 2888us (3150us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1784938332.330252:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 208 00000020:00080000:1.0:1784938332.330261:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1784938332.336328:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938332.336502:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125313792 00000100:00100000:3.0:1784938332.336512:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125313792 00000100:00100000:3.0:1784938332.336576:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:3.0:1784938332.336586:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+34:11919:x1871643125313792:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1784938332.336612:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938332.336634:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef058 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28942 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938332.336691:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef058 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28942 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938332.336706:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef058 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28942 expref: 35 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938332.336726:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:3.0:1784938332.336729:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938332.336733:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1c00, rc 0) 00000100:00100000:3.0:1784938332.338267:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:11919:x1871643125313792:12345-192.168.203.26@tcp:101:bash.0 Request processed in 218us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938332.338281:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:2.0:1784938332.346420:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.346735:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125313920 00000100:00100000:1.0:1784938332.346745:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125313920 00000100:00100000:1.0:1784938332.346820:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:1.0:1784938332.346831:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:11919:x1871643125313920:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938332.346852:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938332.346876:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28949 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938332.346955:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a63ff5a, atime: 0x6a63ff58, ctime: 0x6a63ff5a, blocks: 0x8 00010000:00010000:1.0:1784938332.346978:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1784938332.346983:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938332.346992:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28949 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.347011:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28949 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.347023:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1600, rc 0) 00000100:00100000:1.0:1784938332.347084:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:11919:x1871643125313920:12345-192.168.203.26@tcp:101:bash.0 Request processed in 256us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.347092:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:1.0:1784938332.354133:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938332.354255:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125314048 00000100:00100000:3.0:1784938332.354266:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125314048 00002000:00010000:3.0:1784938332.354309:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1784938332.354314:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cffb64380 with x1871643125314048 ext(0->18446744073709551615) 00002000:00010000:3.0:1784938332.354327:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910cffb64380. 00000100:00100000:3.0:1784938332.354353:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:3.0:1784938332.354378:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125314048:12345-192.168.203.26@tcp:10:bash.0 00002000:00010000:3.0:1784938332.354684:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784938332.354688:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1784938330 -> 1784938332 00002000:00010000:3.0:1784938332.354691:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1784938328 -> 1784938328 00002000:00010000:3.0:1784938332.354693:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1784938330 -> 1784938332 00002000:00010000:3.0:1784938332.354695:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1784938332.354816:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2392:x1871643125314048:12345-192.168.203.26@tcp:10:bash.0 Request processed in 439us (692us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1784938332.354826:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00002000:00010000:3.0:1784938332.354830:0:8435:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1784938332.354833:0:8435:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cffb64380 with x1871643125314048 ext(0->18446744073709551615) 00002000:00010000:3.0:1784938332.354838:0:8435:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910cffb64380. 00000100:00100000:2.0:1784938332.460144:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.460276:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125314176 00000100:00100000:1.0:1784938332.460285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125314176 00000100:00100000:1.0:1784938332.460345:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00100000:1.0:1784938332.460355:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:12401:x1871643125314176:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1784938332.460439:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460473:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460485:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460499:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460506:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460513:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460581:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460589:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460595:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938332.460638:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460649:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460654:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460671:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460676:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.460680:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460687:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460699:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938332.460702:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.460706:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460712:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef066 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460726:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460732:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460737:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460741:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.460743:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460759:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460766:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:1.0:1784938332.460768:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.460771:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460776:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef06d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460791:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460796:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.460801:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.463522:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.463530:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.463540:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.463558:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:1.0:1784938332.463561:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.463566:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.463594:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef074 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938332.463701:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:12401:x1871643125314176:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 3344us (3571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.463708:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00100000:2.0:1784938332.554746:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.554855:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125314432 00000100:00100000:1.0:1784938332.554866:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125314432 00000100:00100000:1.0:1784938332.554933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 211 00000100:00100000:1.0:1784938332.554944:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+35:12404:x1871643125314432:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938332.554965:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938332.554987:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef07b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28950 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.555064:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.555090:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.555101:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.555114:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.555121:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.555146:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.555287:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef090 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.555297:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556712:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938332.556744:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784938332.556848:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556856:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556864:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556870:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.556874:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556881:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556896:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938332.556899:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.556915:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556923:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1000/0x26783cd1c59ef082 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556938:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556944:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556949:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556953:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.556956:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556961:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556968:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:1.0:1784938332.556970:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.556973:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.556978:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0c00/0x26783cd1c59ef089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.557029:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1e00/0x26783cd1c59ef07b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28950 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.557054:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28950 expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.557061:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:1.0:1784938332.557063:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784938332.557065:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215a200, rc 0) 00000100:00100000:1.0:1784938332.557638:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:12404:x1871643125314432:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 2694us (2901us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1784938332.557648:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 211 00000100:00100000:3.0:1784938332.565337:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938332.565429:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125314560 00000100:00100000:0.0:1784938332.565438:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125314560 00000100:00100000:0.0:1784938332.565500:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 212 00000100:00100000:0.0:1784938332.565510:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:12404:x1871643125314560:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1784938332.565577:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.565594:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28934 expref: 37 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.565615:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.565648:0:9526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28934 expref: 37 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.565674:0:9526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28934 expref: 37 pid: 9526 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938332.565687:0:9526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1871643144253696:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938332.565785:0:9526:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf863f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938332.571468:0:9526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9526:1871643144253696:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938332.571499:0:9526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938332.574266:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938332.574426:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125314816 00000100:00100000:2.0:1784938332.574438:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125314816 00000100:00100000:2.0:1784938332.574496:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:2.0:1784938332.574506:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:9924:x1871643125314816:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784938332.575147:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:9924:x1871643125314816:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 639us (927us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1784938332.575156:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1784938332.582319:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.582723:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125314944 00000100:00100000:1.0:1784938332.582734:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125314944 00010000:00010000:1.0:1784938332.582776:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28934 expref: 39 pid: 9526 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938332.583902:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:2.0:1784938332.583920:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:2392:x1871643125314944:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938332.583938:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938332.583948:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28934 expref: 39 pid: 9526 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.583965:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28934 expref: 39 pid: 9526 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.583988:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef035 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28934 expref: 39 pid: 9526 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.584006:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:2.0:1784938332.584011:0:9518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.584020:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.584041:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.584064:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938332.584125:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:2392:x1871643125314944:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 211us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938332.584132:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 96 00010000:00010000:0.0:1784938332.584934:0:9526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.584944:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.584984:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.584989:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.584995:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.585001:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938332.585005:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.585013:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.585037:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:0.0:1784938332.585041:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938332.585045:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.585051:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef09e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938332.585125:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:12404:x1871643125314560:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 19614us (19794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938332.585135:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 212 00000100:00100000:3.0:1784938332.589000:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.589431:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125315200 00000100:00100000:1.0:1784938332.589441:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125315200 00000100:00100000:1.0:1784938332.589507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:1.0:1784938332.589518:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+37:12404:x1871643125315200:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938332.589739:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:12404:x1871643125315200:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 222us (747us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1784938332.589747:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:3.0:1784938332.698903:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.699099:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125315456 00000100:00100000:1.0:1784938332.699110:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125315456 00000100:00100000:1.0:1784938332.699317:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 213 00000100:00100000:1.0:1784938332.699328:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+38:12415:x1871643125315456:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:1.0:1784938332.699364:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938332.699388:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28957 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699540:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699615:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699630:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699646:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699653:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699659:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699768:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef0ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699778:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699785:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938332.699796:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1784938332.699885:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699893:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699899:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699905:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.699909:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699917:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699929:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938332.699932:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.699937:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699942:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699956:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699962:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699968:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699973:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215bc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.699981:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699988:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.699995:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:1.0:1784938332.699998:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.700001:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.700006:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.700047:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28957 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.700059:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef0ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28957 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.700066:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:1.0:1784938332.700068:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938332.700070:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b200, rc 0) 00000100:00100000:1.0:1784938332.700177:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+40:12415:x1871643125315456:12345-192.168.203.26@tcp:101:cat.0 Request processed in 852us (1282us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1784938332.700185:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 213 00000100:00100000:3.0:1784938332.712111:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.712201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125315712 00000100:00100000:1.0:1784938332.712211:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125315712 00000100:00100000:1.0:1784938332.712299:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:1.0:1784938332.712309:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+40:12415:x1871643125315712:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:1.0:1784938332.712624:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+41:12415:x1871643125315712:12345-192.168.203.26@tcp:35:cat.0 Request processed in 315us (520us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1784938332.712632:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:3.0:1784938332.745836:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.745955:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125315968 00000100:00100000:1.0:1784938332.745964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125315968 00000100:00100000:1.0:1784938332.746026:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 214 00000100:00100000:1.0:1784938332.746035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+41:12416:x1871643125315968:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:1.0:1784938332.746094:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1784938332.746120:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef058 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28942 expref: 41 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746145:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef0ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28957 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746158:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef090 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28950 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746170:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef04a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2893b expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746181:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:1.0:1784938332.746186:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938332.746207:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746366:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746397:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746426:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746434:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746441:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746511:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746520:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.746537:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938332.747506:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1784938332.747518:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400779302748ns, next at 401779300161ns, rc = 0 00010000:00010000:1.0:1784938332.747592:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747604:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747612:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747634:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747641:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747647:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747812:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938332.747844:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747851:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747856:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747861:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ae00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.747866:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747873:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747885:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:1.0:1784938332.747887:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938332.747892:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747909:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef0d6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747932:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747938:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747943:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747947:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938332.747951:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747956:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747964:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938332.747966:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938332.747969:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747975:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef0c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938332.747986:0:6514:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009233755f reply state 00000000d988abd3 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.747997:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.748011:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:1.0:1784938332.748013:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938332.748016:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938332.748116:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:12416:x1871643125315968:12345-192.168.203.26@tcp:36:rm.0 Request processed in 2078us (2284us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1784938332.748125:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 214 00010000:00010000:2.0:1784938332.750116:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938332.750129:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.750140:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938332.750144:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.750154:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.750171:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:2.0:1784938332.750174:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938332.750180:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.750186:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef0dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938332.750349:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938332.750352:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938332.750353:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938332.770453:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938332.807813:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938332.808019:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125316224 00000100:00100000:0.0:1784938332.808029:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125316224 00000100:00100000:0.0:1784938332.808096:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 215 00000100:00100000:0.0:1784938332.808106:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+39:12422:x1871643125316224:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1784938332.808130:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938332.808152:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef0e4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2895e expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808308:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808322:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808334:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808357:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808366:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808372:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938332.808724:0:9526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1784938332.808860:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808870:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808878:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808910:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808917:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808922:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808928:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938332.808932:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808950:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808961:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938332.808964:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938332.808968:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808973:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef0eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938332.808987:0:9526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099da2f49 reply state 000000009d16ddbb transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.808996:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.809002:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:0.0:1784938332.809004:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938332.809006:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784938332.809032:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef0e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2895e expref: 42 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.809046:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2895e expref: 41 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.809052:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910bc1799300) 00010000:00010000:0.0:1784938332.809054:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938332.809056:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76e00, rc 0) 00000100:00100000:0.0:1784938332.809130:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+42:12422:x1871643125316224:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1025us (1327us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1784938332.809143:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 215 00000100:00100000:3.0:1784938332.814051:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938332.814150:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125316352 00000100:00100000:2.0:1784938332.814161:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125316352 00000100:00100000:2.0:1784938332.814256:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:2.0:1784938332.814267:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125316352:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1784938332.814298:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938332.814318:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28965 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938332.814343:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938332.814365:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1784938332.814369:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938332.814378:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28965 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.814410:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28965 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.814423:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1200, rc 0) 00000100:00100000:2.0:1784938332.814482:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125316352:12345-192.168.203.26@tcp:101:bash.0 Request processed in 217us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938332.814489:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00080000:3.0:1784938332.814657:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938332.819627:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.819927:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125316480 00000100:00100000:1.0:1784938332.819936:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125316480 00000100:00100000:1.0:1784938332.819992:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:1.0:1784938332.820002:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:12422:x1871643125316480:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938332.820019:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938332.820036:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2896c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.820066:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28965 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.820075:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938332.820078:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938332.820083:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.820114:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28965 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.820127:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28965 expref: 9 pid: 8430 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938332.820154:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1871643144253824:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938332.820274:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc73826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938332.823826:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938332.824010:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125316608 00000100:00100000:2.0:1784938332.824019:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125316608 00010000:00010000:2.0:1784938332.824056:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28965 expref: 10 pid: 8430 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938332.824101:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:2.0:1784938332.824111:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:2392:x1871643125316608:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938332.824125:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938332.824162:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28965 expref: 10 pid: 8430 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.824176:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28965 expref: 10 pid: 8430 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.824200:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938332.824205:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938332.824242:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.824254:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.824292:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938332.824306:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1871643144253952:192.168.203.26@tcp:105: 00000100:00100000:2.0:1784938332.824385:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d480 going to sleep for 11 seconds 00010000:00010000:1.0:1784938332.825205:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b7794e9/0x26783cd1c59ef107 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28965 expref: 10 pid: 8430 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938332.825249:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8431:1871643144253824:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938332.825274:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.825286:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215ba00, rc 0) 00000100:00100000:1.0:1784938332.825339:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:12422:x1871643125316480:12345-192.168.203.26@tcp:101:bash.0 Request processed in 5338us (5720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.825347:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:0.0:1784938332.833757:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938332.833878:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125316864 00000100:00100000:1.0:1784938332.833889:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125316864 00000100:00100000:1.0:1784938332.833996:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:1.0:1784938332.834008:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+42:12422:x1871643125316864:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:2.0:1784938332.834172:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1871643144253952:192.168.203.26@tcp:105: 00010000:00010000:2.0:1784938332.834194:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938332.834269:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125316608:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 10158us (10452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938332.834278:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:1.0:1784938332.834310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+43:12422:x1871643125316864:12345-192.168.203.26@tcp:35:bash.0 Request processed in 304us (559us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1784938332.834319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:2.0:1784938333.044750:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938333.044876:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125316992 00000100:00100000:1.0:1784938333.044886:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125316992 00000100:00100000:1.0:1784938333.044952:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 216 00000100:00100000:1.0:1784938333.044978:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+43:12438:x1871643125316992:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938333.045019:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938333.045041:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef115 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28973 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.045125:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef11c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.045141:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.045155:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938333.045200:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1784938333.045203:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938333.045254:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef11c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.045279:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28973 expref: 45 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.045311:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef11c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28973 expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.045321:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938333.045324:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938333.045327:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215a200, rc 0) 00000100:00100000:1.0:1784938333.045444:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+44:12438:x1871643125316992:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 468us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.045461:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 216 00000100:00100000:3.0:1784938333.069020:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938333.069138:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125317248 00000100:00100000:1.0:1784938333.069156:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125317248 00000100:00100000:1.0:1784938333.069287:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00100000:1.0:1784938333.069298:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+44:12438:x1871643125317248:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938333.069320:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938333.069344:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef123 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2897a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.069468:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef12a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.069482:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.069494:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938333.069506:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1784938333.069613:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef123 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2897a expref: 47 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.069633:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef12a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2897a expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.069642:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910bc1799300) 00010000:00010000:1.0:1784938333.069645:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938333.069648:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b200, rc 0) 00000100:00100000:1.0:1784938333.069733:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+46:12438:x1871643125317248:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 436us (729us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1784938333.069741:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00100000:0.0:1784938333.080849:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.080967:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125317504 00000100:00100000:3.0:1784938333.080990:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125317504 00000100:00100000:3.0:1784938333.081057:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 218 00000100:00100000:3.0:1784938333.081068:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+46:12438:x1871643125317504:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938333.081096:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938333.081122:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef138 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28981 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.081264:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef13f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.081278:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef13f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.081290:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef13f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938333.081303:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784938333.081412:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef138 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28981 expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.081441:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef13f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28981 expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.081450:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910bc1799300) 00010000:00010000:3.0:1784938333.081452:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784938333.081456:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0a00, rc 0) 00000100:00100000:3.0:1784938333.081521:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+48:12438:x1871643125317504:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 454us (683us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1784938333.081861:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 218 00000100:00100000:2.0:1784938333.086867:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938333.086972:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125317632 00000100:00100000:0.0:1784938333.086981:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125317632 00000100:00100000:0.0:1784938333.087045:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:0.0:1784938333.087056:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+48:2392:x1871643125317632:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938333.087072:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938333.087097:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef12a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2897a expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938333.087118:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910bc1799300) 00010000:00010000:0.0:1784938333.087123:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938333.087175:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+47:2392:x1871643125317632:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 122us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938333.087183:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:0.0:1784938333.096304:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938333.096406:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125317760 00000100:00100000:2.0:1784938333.096416:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125317760 00000100:00100000:2.0:1784938333.096477:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:2.0:1784938333.096485:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2394:x1871643125317760:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:2.0:1784938333.096538:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.096561:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.096571:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784938333.096575:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938333.096580:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.096614:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.096627:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 8 pid: 8431 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938333.096641:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1871643144254080:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938333.096739:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938333.101611:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1871643144254080:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938333.101657:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938333.102997:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938333.103091:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125317888 00000100:00100000:2.0:1784938333.103099:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125317888 00002000:00100000:2.0:1784938333.103157:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff910bc7ccad80 x1871643125317888/t0(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:564/0 lens 504/0 e 0 to 0 dl 1784938344 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938333.103169:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc7ccad80 with x1871643125317888 ext(0->8) 00010000:00010000:2.0:1784938333.103179:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 9 pid: 8431 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.103195:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 9 pid: 8431 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938333.103202:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910bc7ccad80 00000100:00100000:2.0:1784938333.103267:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:2.0:1784938333.103277:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125317888:12345-192.168.203.26@tcp:4:lfs.0 00000100:00100000:2.0:1784938333.105151:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:2393:x1871643125317888:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 1868us (2153us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784938333.105163:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00002000:00100000:2.0:1784938333.105175:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff910bc7ccad80 x1871643125317888/t4294967309(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:564/0 lens 504/448 e 0 to 0 dl 1784938344 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938333.105185:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc7ccad80 with x1871643125317888 ext(0->8) 00010000:00010000:2.0:1784938333.105194:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 11 pid: 8431 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.105254:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 11 pid: 8431 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938333.105262:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910bc7ccad80 00000100:00100000:3.0:1784938333.112304:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938333.119508:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125318016 00000100:00100000:1.0:1784938333.119587:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125318016 00010000:00010000:1.0:1784938333.119644:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 11 pid: 8431 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938333.119747:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:1.0:1784938333.119757:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8467480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:2395:x1871643125318016:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938333.119773:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784938333.119792:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784938333.119796:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784938332 00002000:00010000:1.0:1784938333.119798:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784938332 00002000:00010000:1.0:1784938333.119800:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1784938332 00002000:00010000:1.0:1784938333.119803:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784938333.119811:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 11 pid: 8431 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.119826:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 11 pid: 8431 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.119850:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bd53e14/0x26783cd1c59ef10e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2896c expref: 11 pid: 8431 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.119868:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938333.119872:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938333.119894:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.119918:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.119955:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938333.120028:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8467480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:2395:x1871643125318016:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 272us (7732us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.120036:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 98 00010000:00010000:2.0:1784938333.120100:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.120110:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.120129:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.120137:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.120146:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.120153:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938333.120157:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.120166:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.120193:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.120200:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023098c38/0x26783cd1c59ef14d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938333.120263:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2394:x1871643125317760:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 23779us (24059us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.120271:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:3.0:1784938333.128679:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938333.128795:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125318272 00000100:00100000:2.0:1784938333.128804:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125318272 00000100:00100000:2.0:1784938333.128855:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:2.0:1784938333.128864:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+47:12438:x1871643125318272:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:2.0:1784938333.128931:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef13f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28981 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938333.129114:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1784938333.129148:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1784938333.129458:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1784938333.129492:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.129507:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2895e expref: 51 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.129516:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.129745:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2895e expref: 51 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.129760:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2895e expref: 51 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938333.129774:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1871643144254208:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938333.129847:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938333.142641:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938333.142886:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125318400 00000100:00100000:1.0:1784938333.142896:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125318400 00010000:00010000:1.0:1784938333.142935:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2895e expref: 52 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938333.142989:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 99 00000100:00100000:1.0:1784938333.142998:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+52:2393:x1871643125318400:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938333.143023:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938333.143030:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2895e expref: 52 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.143044:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2895e expref: 52 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.143067:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910bc1799300) 00010000:00010000:1.0:1784938333.143073:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.143101:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.143107:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.143128:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938333.143188:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+52:2393:x1871643125318400:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 190us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.143195:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 99 00010000:00010000:2.0:1784938333.145848:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76e00/0x26783cd1c59ef0f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2895e expref: 51 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938333.145875:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1871643144254208:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938333.145898:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.145920:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.145926:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938333.146038:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1784938333.146142:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1784938333.146276:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144254336:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784938333.146349:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938333.146887:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938333.147141:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144254336 00000100:00100000:1.0:1784938333.147149:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144254336 00000100:00080000:3.0:1784938333.147205:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938333.147306:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 209 00000100:00100000:1.0:1784938333.147316:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1871643144254336:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784938333.147430:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1871643144254336:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 Request processed in 107us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.147437:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 209 00000100:00100000:2.0:1784938333.149272:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144254336:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784938333.149671:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1784938333.149749:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144254464:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784938333.149822:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674db40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938333.150243:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938333.150349:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144254464 00000100:00100000:1.0:1784938333.150356:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144254464 00000100:00100000:1.0:1784938333.150416:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 210 00000100:00100000:1.0:1784938333.150598:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1871643144254464:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784938333.150734:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6515:x1871643144254464:12345-192.168.203.126@tcp:1000:mdt_rdpg00_000.0 Request processed in 310us (492us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784938333.150742:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 210 00000100:00100000:2.0:1784938333.152365:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1871643144254464:192.168.203.126@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784938333.152449:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1784938333.152501:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.152512:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.152519:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.152525:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938333.152529:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.152537:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.152553:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910bc1799300) 00010000:00010000:2.0:1784938333.152556:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784938333.152561:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.152567:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef154 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938333.152668:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784938333.152745:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1784938333.152756:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401184541158ns, next at 402184538608ns, rc = 0 00000001:00080000:2.0:1784938333.152763:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1784938333.152785:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910bc1799300) 00010000:00010000:2.0:1784938333.152788:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784938333.152794:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef13f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28981 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938333.152885:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:12438:x1871643125318272:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 24023us (24214us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1784938333.152892:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000020:00080000:2.0:1784938333.152896:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784938333.159460:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.159548:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125318528 00000100:00100000:3.0:1784938333.159558:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125318528 00000100:00100000:3.0:1784938333.159617:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:3.0:1784938333.159627:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+54:12438:x1871643125318528:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938333.159653:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938333.159676:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ef15b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28988 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.159736:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ef15b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28988 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.159751:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ef15b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28988 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.159768:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938333.159771:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938333.159774:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0c00, rc 0) 00000100:00100000:3.0:1784938333.159830:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+55:12438:x1871643125318528:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 205us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.159836:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:0.0:1784938333.170617:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.170768:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125318784 00000100:00100000:3.0:1784938333.170778:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125318784 00000100:00100000:3.0:1784938333.170847:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1784938333.170858:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+55:12438:x1871643125318784:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1784938333.171272:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+56:12438:x1871643125318784:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 413us (661us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1784938333.171280:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:1.0:1784938333.284794:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938333.284923:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125318912 00000100:00100000:2.0:1784938333.284933:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125318912 00000100:00100000:2.0:1784938333.284990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00100000:2.0:1784938333.285001:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+56:12448:x1871643125318912:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:2.0:1784938333.285074:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285094:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285105:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285115:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285133:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285152:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285259:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285267:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285273:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938333.285329:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285343:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285351:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285357:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285363:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938333.285367:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285374:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285387:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938333.285407:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938333.285414:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285420:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef162 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285434:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285439:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285445:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285450:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938333.285452:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285457:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285465:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:2.0:1784938333.285467:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938333.285470:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285475:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285483:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285495:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285500:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285506:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938333.285509:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285515:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285523:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938333.285525:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938333.285529:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.285535:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef170 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938333.285613:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+56:12448:x1871643125318912:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 613us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.285621:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00100000:1.0:1784938333.324433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938333.324508:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125319168 00000100:00100000:2.0:1784938333.324517:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125319168 00000100:00100000:2.0:1784938333.324576:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 221 00000100:00100000:2.0:1784938333.324585:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+56:12451:x1871643125319168:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938333.324607:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938333.324649:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef177 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2898f expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.324748:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.324766:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.324779:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.324791:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.324799:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.324805:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.324913:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.324922:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.324929:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938333.324937:0:13805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784938333.325018:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325035:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325042:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325047:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938333.325052:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325059:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325071:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938333.325074:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938333.325079:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325085:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef17e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325100:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325106:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325112:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325116:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938333.325140:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325147:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325155:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:2.0:1784938333.325158:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938333.325160:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325167:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef185 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325203:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef177 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2898f expref: 59 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325266:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2898f expref: 58 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.325274:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938333.325276:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938333.325279:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0000, rc 0) 00000100:00100000:2.0:1784938333.325346:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+58:12451:x1871643125319168:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 762us (921us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1784938333.325353:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 221 00000100:00100000:0.0:1784938333.329846:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.331734:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125319296 00000100:00100000:3.0:1784938333.331748:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125319296 00000100:00100000:3.0:1784938333.331824:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 222 00000100:00100000:3.0:1784938333.331835:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+58:12451:x1871643125319296:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1784938333.331905:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.331922:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.331940:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.332058:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.332066:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.332071:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.332302:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938333.332308:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.332317:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.332478:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938333.332481:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938333.332487:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.332493:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef19a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938333.332678:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+58:12451:x1871643125319296:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 843us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.332688:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 222 00000100:00100000:1.0:1784938333.336141:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.336329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125319552 00000100:00100000:3.0:1784938333.336341:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125319552 00000100:00100000:3.0:1784938333.336425:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:3.0:1784938333.336435:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+58:12451:x1871643125319552:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1784938333.336679:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+59:12451:x1871643125319552:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 244us (546us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1784938333.336687:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:1.0:1784938333.432879:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.433035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125319808 00000100:00100000:3.0:1784938333.433044:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125319808 00000100:00100000:3.0:1784938333.433100:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 223 00000100:00100000:3.0:1784938333.433110:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+59:12461:x1871643125319808:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1784938333.433141:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938333.433144:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784938333.433172:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef11c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28973 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.433263:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:3.0:1784938333.433269:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938333.433286:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28996 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.435079:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.435107:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2898f expref: 59 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.435116:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.435167:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2898f expref: 59 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.435185:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2898f expref: 59 pid: 13805 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938333.435200:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8464000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144254592:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938333.435586:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d61cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938333.444950:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938333.445031:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125319936 00000100:00100000:2.0:1784938333.445041:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125319936 00010000:00010000:2.0:1784938333.445081:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2898f expref: 60 pid: 13805 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938333.445142:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 100 00000100:00100000:2.0:1784938333.445152:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:2392:x1871643125319936:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938333.445168:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938333.445175:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2898f expref: 60 pid: 13805 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.445188:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2898f expref: 60 pid: 13805 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.445208:0:9518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938333.445249:0:9518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.445260:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.445268:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.445288:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938333.445349:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:2392:x1871643125319936:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 199us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.445357:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 100 00010000:00010000:3.0:1784938333.445744:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef18c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2898f expref: 59 pid: 13805 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938333.445765:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8464000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144254592:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938333.445798:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.445808:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.445814:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938333.445830:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784938333.445952:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28996 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.445977:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28996 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.445985:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938333.445988:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784938333.445991:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1200, rc 0) 00000100:00100000:3.0:1784938333.446024:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+59:12461:x1871643125319808:12345-192.168.203.26@tcp:101:bash.0 Request processed in 12916us (13155us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1784938333.446032:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 223 00000100:00100000:1.0:1784938333.450133:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.450252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125320064 00000100:00100000:3.0:1784938333.450263:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125320064 00000100:00100000:3.0:1784938333.450321:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 224 00000100:00100000:3.0:1784938333.450332:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+59:12461:x1871643125320064:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1784938333.450356:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938333.450378:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1800/0x26783cd1c59ef1b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a2899d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.450451:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.450466:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.450478:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.450587:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1800/0x26783cd1c59ef1b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2899d expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.450606:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2899d expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.450615:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938333.450619:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784938333.450622:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0a00, rc 0) 00000100:00100000:3.0:1784938333.450682:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:12461:x1871643125320064:12345-192.168.203.26@tcp:101:bash.0 Request processed in 352us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.450689:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 224 00000100:00100000:1.0:1784938333.454759:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.454842:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125320320 00000100:00100000:3.0:1784938333.454852:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125320320 00000100:00100000:3.0:1784938333.454913:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 225 00000100:00100000:3.0:1784938333.454922:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+60:12461:x1871643125320320:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:3.0:1784938333.455269:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.455303:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.455314:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938333.455358:0:9526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1784938333.455383:0:9526:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2b5e0a2 reply state 0000000058f933bb transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.455505:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.455515:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938333.455739:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938333.455745:0:9526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938333.456045:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:12461:x1871643125320320:12345-192.168.203.26@tcp:36:bash.0 Request processed in 1121us (1292us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1784938333.456053:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 225 00000020:00080000:2.0:1784938333.456067:0:9526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784938333.463695:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.463907:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125320448 00000100:00100000:3.0:1784938333.463917:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125320448 00000100:00100000:3.0:1784938333.463982:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 226 00000100:00100000:3.0:1784938333.463993:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:12461:x1871643125320448:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1784938333.464019:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938333.464039:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1800/0x26783cd1c59ef1cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289a4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.464131:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.464145:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28996 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.464173:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.464208:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28996 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.464264:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28996 expref: 64 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938333.464278:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8464000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144254720:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938333.468546:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d61cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938333.474078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.474167:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125320576 00000100:00100000:3.0:1784938333.474176:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125320576 00010000:00010000:3.0:1784938333.474253:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28996 expref: 65 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938333.474292:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:3.0:1784938333.474302:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:2392:x1871643125320576:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938333.474317:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938333.474323:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28996 expref: 65 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.474337:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28996 expref: 65 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.474358:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938333.474363:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.474386:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.474415:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.474438:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938333.474486:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:2392:x1871643125320576:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 187us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.474494:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 101 00010000:00010000:2.0:1784938333.475202:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59ef1a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28996 expref: 64 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938333.475250:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8464000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144254720:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938333.475274:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.475283:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.475289:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938333.475344:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784938333.475348:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938333.475368:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.475408:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1800/0x26783cd1c59ef1cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289a4 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.475422:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289a4 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.475430:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938333.475432:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938333.475436:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0000, rc 0) 00000100:00100000:2.0:1784938333.475487:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:12461:x1871643125320448:12345-192.168.203.26@tcp:101:bash.0 Request processed in 11496us (11801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.475503:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 226 00000100:00100000:1.0:1784938333.484803:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.484915:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125320832 00000100:00100000:3.0:1784938333.484923:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125320832 00000100:00100000:3.0:1784938333.484985:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:3.0:1784938333.484995:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+63:12461:x1871643125320832:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:3.0:1784938333.485357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+64:12461:x1871643125320832:12345-192.168.203.26@tcp:35:bash.0 Request processed in 363us (562us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1784938333.485366:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1784938333.588716:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938333.589490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125320960 00000100:00100000:2.0:1784938333.589501:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125320960 00000100:00100000:2.0:1784938333.589575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:2.0:1784938333.589586:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+64:12467:x1871643125320960:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938333.589624:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938333.589645:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef1d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.589710:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef1e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.589726:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.589738:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938333.589779:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784938333.589784:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938333.589801:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.589825:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1200/0x26783cd1c59ef1d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ab expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.589844:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ab expref: 65 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.589873:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938333.589876:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938333.589880:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0400, rc 0) 00000100:00100000:2.0:1784938333.589945:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:12467:x1871643125320960:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 361us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.589953:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:0.0:1784938333.596807:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938333.597271:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125321088 00000100:00100000:2.0:1784938333.597282:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125321088 00000100:00100000:2.0:1784938333.597418:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 228 00000100:00100000:2.0:1784938333.597430:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:12467:x1871643125321088:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938333.597452:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938333.597475:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef1e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289b2 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.597540:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.597556:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.597568:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.597579:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.597587:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598668:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598750:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598761:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598768:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938333.598809:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784938333.598813:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938333.598831:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598843:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598852:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598858:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598864:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598871:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938333.598876:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598891:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598904:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938333.598907:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938333.598911:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598918:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0c00/0x26783cd1c59ef1ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598932:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598938:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598944:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598949:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938333.598952:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598958:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598964:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:2.0:1784938333.598966:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938333.598969:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.598984:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0a00/0x26783cd1c59ef1f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.599016:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef1e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 67 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.599029:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 66 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.599037:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938333.599039:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938333.599041:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1000, rc 0) 00000100:00100000:2.0:1784938333.599119:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:12467:x1871643125321088:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1690us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.599128:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 228 00000100:00100000:0.0:1784938333.607042:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938333.607099:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.607185:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125321472 00000100:00100000:3.0:1784938333.607194:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125321472 00000100:00100000:3.0:1784938333.607261:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 229 00000100:00100000:3.0:1784938333.607270:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:12467:x1871643125321472:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938333.607290:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938333.607310:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef203 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.607435:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.607457:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289a4 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.607465:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 67 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.607473:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.607504:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 67 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.607517:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 67 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938333.607530:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8464700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144254848:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938333.607618:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289a4 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.607678:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289a4 expref: 67 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938333.607687:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8466300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144254976:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938333.607710:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d61180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938333.607891:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125321216 00000100:00100000:2.0:1784938333.607897:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125321216 00010000:00010000:2.0:1784938333.607920:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 68 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938333.607952:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:2.0:1784938333.607959:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:2395:x1871643125321216:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938333.607969:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938333.607974:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 68 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.607996:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 68 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.608012:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938333.608017:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.608025:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.608030:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938333.608052:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:2395:x1871643125321216:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 94us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.608058:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 102 00010000:00010000:3.0:1784938333.610282:0:6512:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.26@tcp) returned -22 from blocking AST (req@00000000a382b971 x1871643144254848) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 67 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.610326:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1000/0x26783cd1c59ef1fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b2 expref: 67 pid: 9526 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938333.610344:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8464700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144254848:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938333.610361:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8466300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144254976:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938333.610780:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938333.610788:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.610797:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938333.610806:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938333.611053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938333.611135:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125321600 00000100:00100000:1.0:1784938333.611142:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125321600 00010000:00010000:1.0:1784938333.611176:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289a4 expref: 67 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938333.611246:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:1.0:1784938333.611257:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:2392:x1871643125321600:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938333.611271:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938333.611277:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289a4 expref: 67 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.611290:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289a4 expref: 67 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.611310:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59ef1d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289a4 expref: 67 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.611324:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938333.611328:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.611346:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.611354:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.611529:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.611537:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938333.611555:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784938333.611688:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef203 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b9 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.611704:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b9 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.611712:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938333.611720:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938333.611723:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0600, rc 0) 00000100:00100000:2.0:1784938333.611780:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:12467:x1871643125321472:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 4511us (4680us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1784938333.611788:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 229 00010000:00010000:1.0:1784938333.612131:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938333.612169:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:2392:x1871643125321600:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 914us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.612177:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:0.0:1784938333.620615:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938333.620736:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125321856 00000100:00100000:1.0:1784938333.620746:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125321856 00000100:00100000:1.0:1784938333.620805:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:1.0:1784938333.620815:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:12467:x1871643125321856:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:1.0:1784938333.620829:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938333.620852:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0c00/0x26783cd1c59ef15b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28988 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.620872:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938333.620877:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938333.620931:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:12467:x1871643125321856:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.620939:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:0.0:1784938333.626310:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938333.626435:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125321984 00000100:00100000:1.0:1784938333.626445:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125321984 00000100:00100000:1.0:1784938333.626505:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00100000:1.0:1784938333.626516:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:12467:x1871643125321984:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:1.0:1784938333.626658:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.626676:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938333.626688:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938333.626783:0:13805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1784938333.626858:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:12467:x1871643125321984:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 343us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.626866:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00100000:0.0:1784938333.637328:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938333.637526:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125322112 00000100:00100000:2.0:1784938333.637535:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125322112 00000100:00100000:2.0:1784938333.637587:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 231 00000100:00100000:2.0:1784938333.637603:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+65:12467:x1871643125322112:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938333.637621:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938333.637639:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289c0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.637688:0:9526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.637698:0:9526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c0 expref: 66 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.637715:0:9526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.637727:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c0 expref: 66 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.637739:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938333.637742:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938333.637745:0:9526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c0 expref: 66 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938333.637765:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0e00, rc 0) 00000100:00100000:2.0:1784938333.637818:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:12467:x1871643125322112:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 222us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.637824:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 231 00010000:00010000:1.0:1784938333.791913:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938333.822806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938333.822854:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938333.822880:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938333.822909:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938333.822941:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938333.822986:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938333.823017:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125322240 00000100:00100000:0.0:1784938333.823030:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125322368 00000100:00100000:3.0:1784938333.823035:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125322240 00000100:00100000:0.0:1784938333.823041:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125322368 00000100:00100000:0.0:1784938333.823136:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125322752 00000100:00100000:0.0:1784938333.823141:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125322752 00000100:00100000:3.0:1784938333.823150:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 398 00000100:00100000:3.0:1784938333.823166:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125322240:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938333.823171:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125322880 00000100:00100000:0.0:1784938333.823177:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125322880 00000100:00100000:0.0:1784938333.823202:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 359 00000100:00100000:0.0:1784938333.823253:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125322368:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.823320:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125322240:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 158us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.823329:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 398 00000100:00100000:0.0:1784938333.823341:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125322368:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 127us (541us total) trans 0 rc 0/0 00000100:00080000:3.0:1784938333.823378:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938333.823385:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938333.823556:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125322496 00000100:00100000:1.0:1784938333.823562:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125322496 00000100:00100000:1.0:1784938333.823589:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125322624 00000100:00100000:1.0:1784938333.823592:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125322624 00000100:00100000:1.0:1784938333.823620:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:1.0:1784938333.823632:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2392:x1871643125322496:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938333.823678:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 359 00000100:00100000:0.0:1784938333.823699:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 360 00000100:00100000:0.0:1784938333.823706:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125322752:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938333.823774:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:2.0:1784938333.823783:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125322624:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.828369:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2392:x1871643125322496:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 4719us (5464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.828387:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00080000:1.0:1784938333.828456:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938333.828497:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 361 00000100:00100000:1.0:1784938333.828512:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125322880:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.828570:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125322880:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 65us (5583us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.828598:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 361 00000100:00100000:0.0:1784938333.831691:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125322752:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 7973us (8768us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938333.831708:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 360 00000100:00100000:2.0:1784938333.831839:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125322624:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 8055us (8895us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.831850:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 145 00000004:00080000:1.0:1784938333.855623:0:9814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401887405968ns, next at 402887403175ns, rc = 0 00000100:00100000:2.0:1784938333.855779:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938333.855805:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144255104:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938333.856172:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938333.856408:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144255104 00000100:00100000:2.0:1784938333.856416:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144255104 00000100:00100000:2.0:1784938333.856481:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 156 00000100:00100000:2.0:1784938333.856490:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1871643144255104:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938333.856527:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784938333.856569:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1871643144255104:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 79us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.856576:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 156 00000100:00080000:0.0:1784938333.856703:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938333.857253:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144255104:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938333.858004:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144255232:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938333.858321:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938333.858361:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144255232 00000100:00100000:0.0:1784938333.858368:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144255232 00000100:00100000:0.0:1784938333.858434:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 157 00000100:00100000:0.0:1784938333.858444:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144255232:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938333.858465:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784938333.858502:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144255232:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 60us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938333.858510:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 157 00000100:00080000:0.0:1784938333.858662:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938333.859260:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144255232:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938333.859915:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144255616:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938333.860020:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144255488:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938333.860824:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938333.860835:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144255360:0@lo:400:kworker.0 00000100:00100000:2.0:1784938333.860883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938333.861908:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144255744:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938333.862142:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938333.862173:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938333.862195:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938333.862256:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144255616 00000100:00100000:3.0:1784938333.862260:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144255488 00000100:00100000:0.0:1784938333.862264:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144255616 00000100:00100000:3.0:1784938333.862267:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144255488 00000100:00100000:3.0:1784938333.862315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144255744 00000100:00100000:0.0:1784938333.862316:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 211 00000100:00100000:3.0:1784938333.862320:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144255744 00000100:00100000:0.0:1784938333.862328:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144255616:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.862347:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 362 00000100:00100000:3.0:1784938333.862356:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144255488:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.862802:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 363 00000100:00100000:1.0:1784938333.862813:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144255744:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.863716:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144255744:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 899us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.863872:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144255360 00000100:00100000:2.0:1784938333.863879:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144255360 00000100:00100000:2.0:1784938333.863920:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1784938333.863928:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144255360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938333.863983:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144255360:12345-0@lo:400:kworker.0 Request processed in 55us (3100us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.863990:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1784938333.864043:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144255360:0@lo:400:kworker.0 00000100:00100000:3.0:1784938333.864149:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144255488:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 1792us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.864158:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 362 00000100:00100000:3.0:1784938333.864421:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144255616:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.864489:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144255744:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938333.864718:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144255616:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 2390us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938333.864728:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 211 00000100:00100000:2.0:1784938333.864828:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144255488:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.872133:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 363 00000100:00100000:2.0:1784938333.877069:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144255872:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.877421:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938333.877467:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144255872 00000100:00100000:3.0:1784938333.877474:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144255872 00000100:00100000:3.0:1784938333.877518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 212 00000100:00100000:3.0:1784938333.877526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144255872:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.877576:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144255872:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.877583:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 212 00000100:00100000:3.0:1784938333.883751:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144256000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.884037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938333.884061:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144256000 00000100:00100000:3.0:1784938333.884067:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144256000 00000100:00100000:3.0:1784938333.884127:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 364 00000100:00100000:3.0:1784938333.884134:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144256000:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.884173:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144256000:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 39us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.884180:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 364 00000100:00080000:3.0:1784938333.884238:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938333.888673:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144256000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938333.889086:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144255872:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.890370:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144256256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.890608:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938333.890617:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144256128:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.890666:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144256512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.890694:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938333.890699:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144256384:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.891720:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938333.891756:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938333.891785:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938333.891866:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144256256 00000100:00100000:1.0:1784938333.891874:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144256256 00000100:00100000:1.0:1784938333.891939:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 146 00000100:00100000:1.0:1784938333.891948:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144256256:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938333.892000:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144256256:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 53us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.892007:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 146 00000100:00080000:1.0:1784938333.892040:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938333.892343:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144256256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.892708:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938333.893666:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144256128 00000100:00100000:2.0:1784938333.893675:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144256128 00000100:00100000:0.0:1784938333.893769:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144256512 00000100:00100000:0.0:1784938333.893774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144256512 00000100:00080000:2.0:1784938333.893927:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938333.893970:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144256384 00000100:00100000:3.0:1784938333.893975:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144256384 00000100:00100000:3.0:1784938333.894018:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 365 00000100:00100000:3.0:1784938333.894027:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144256128:12345-192.168.203.126@tcp:400:kworker.0 00000100:00080000:2.0:1784938333.894153:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938333.894271:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144256128:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 245us (2512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.894279:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 365 00000100:00100000:3.0:1784938333.894298:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 366 00000100:00100000:3.0:1784938333.894305:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144256384:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.894332:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144256384:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.894338:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 366 00000100:00100000:3.0:1784938333.900940:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 367 00000100:00100000:3.0:1784938333.900956:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144256512:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938333.902163:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1871643144256512:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 1202us (10368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938333.902176:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 367 00010000:00080000:0.0:1784938333.902587:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb65f80 x1871643144256128/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938333.902621:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144256128:192.168.203.126@tcp:400:kworker.0 00000100:00080000:1.0:1784938333.902800:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938333.903275:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144256384:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938333.903291:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb67b80 x1871643144256512/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938333.903299:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144256512:192.168.203.126@tcp:400:kworker.0 00000040:00080000:1.0:1784938333.985417:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938333.985427:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938333.985454:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1784938333.985466:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784938333.985614:0:13794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144256640:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784938333.985953:0:13794:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938333.990881:0:13794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144256640:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784938334.000102:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938334.000285:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125323008 00000100:00100000:3.0:1784938334.000295:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125323008 00000100:00100000:3.0:1784938334.000428:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 232 00000100:00100000:3.0:1784938334.000439:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:12468:x1871643125323008:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784938334.000483:0:6514:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784938334.000620:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:12468:x1871643125323008:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 183us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938334.000628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 232 00000100:00080000:0.0:1784938334.001081:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938334.015899:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.016000:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125323136 00000100:00100000:1.0:1784938334.016010:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125323136 00000100:00100000:1.0:1784938334.016080:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 233 00000100:00100000:1.0:1784938334.016089:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:12468:x1871643125323136:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784938334.016168:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016185:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016198:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016256:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016265:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016273:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016315:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016324:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016330:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938334.016378:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784938334.016383:0:9526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938334.016409:0:9526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016421:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016427:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016434:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016440:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938334.016444:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016451:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016463:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:1.0:1784938334.016472:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938334.016477:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016483:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef226 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016497:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016502:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016508:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016752:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938334.016755:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016762:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016770:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff910bc65fce00) 00010000:00010000:1.0:1784938334.016773:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938334.016776:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016781:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef22d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016797:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016808:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016813:0:9526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016818:0:9526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938334.016821:0:9526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016826:0:9526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016832:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938334.016834:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938334.016837:0:9526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.016842:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef234 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938334.016918:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:12468:x1871643125323136:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 828us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.016926:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 233 00000100:00100000:2.0:1784938334.021967:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938334.022075:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125323392 00000100:00100000:3.0:1784938334.022084:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125323392 00000100:00100000:3.0:1784938334.022150:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 234 00000100:00100000:3.0:1784938334.022160:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+66:12468:x1871643125323392:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938334.022181:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938334.022202:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef23b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289c7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.022665:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.022800:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.022814:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938334.022827:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784938334.022905:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.022913:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.022920:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.022926:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938334.022930:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.022938:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.022950:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938334.022953:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784938334.022958:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.022964:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1a00/0x26783cd1c59ef242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.023005:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef23b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c7 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.023022:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:3.0:1784938334.023024:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938334.023029:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef23b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c7 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.023039:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1600, rc 0) 00000100:00100000:3.0:1784938334.026527:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:12468:x1871643125323392:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 4350us (4550us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1784938334.026541:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 234 00000100:00100000:2.0:1784938334.029951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.040184:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125323520 00000100:00100000:1.0:1784938334.040205:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125323520 00000100:00100000:1.0:1784938334.040409:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 235 00000100:00100000:1.0:1784938334.040422:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:12468:x1871643125323520:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784938334.040477:0:6512:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784938334.040675:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:12468:x1871643125323520:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 256us (10741us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.040684:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 235 00000100:00100000:2.0:1784938334.044204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.044418:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125323776 00000100:00100000:0.0:1784938334.044432:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125323776 00000100:00100000:0.0:1784938334.044511:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 236 00000100:00100000:0.0:1784938334.044523:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:12468:x1871643125323776:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938334.044552:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938334.044557:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784938334.044592:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0400/0x26783cd1c59ef1e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ab expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.044616:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938334.044623:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938334.044641:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef250 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289ce expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938334.045210:0:13805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1784938334.045466:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef257 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.045482:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.045494:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.045585:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef250 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ce expref: 69 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.045606:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ce expref: 68 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.045615:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc1799900) 00010000:00010000:0.0:1784938334.045618:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938334.045622:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76600, rc 0) 00000100:00100000:0.0:1784938334.045710:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:12468:x1871643125323776:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1188us (1521us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1784938334.045718:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 236 00000100:00100000:3.0:1784938334.055793:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.055904:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125324032 00000100:00100000:0.0:1784938334.055919:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125324032 00000100:00100000:0.0:1784938334.056011:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 237 00000100:00100000:0.0:1784938334.056023:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:12468:x1871643125324032:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784938334.056108:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938334.056145:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef257 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ce expref: 68 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056172:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc1799900) 00010000:00010000:0.0:1784938334.056188:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938334.056274:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056293:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056325:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056344:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056352:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056359:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056431:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056440:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056447:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056454:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938334.056459:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056469:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056478:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:0.0:1784938334.056482:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938334.056487:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056503:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef265 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056516:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056523:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056530:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056536:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938334.056539:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056547:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056555:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe26799b3 (ffff910bc1799a00) 00010000:00010000:0.0:1784938334.056558:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938334.056561:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.056568:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef26c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe26799b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938334.056680:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:12468:x1871643125324032:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 659us (900us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938334.056689:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 237 00000100:00100000:2.0:1784938334.067190:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.067409:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125324160 00000100:00100000:1.0:1784938334.067421:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125324160 00000100:00100000:1.0:1784938334.067509:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 238 00000100:00100000:1.0:1784938334.067520:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+67:12468:x1871643125324160:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938334.067549:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938334.067581:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef273 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.067633:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.067649:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.067663:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.067845:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef273 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289d5 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.067871:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289d5 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.067880:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:1.0:1784938334.067883:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784938334.067888:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b200, rc 0) 00000100:00100000:1.0:1784938334.068106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:12468:x1871643125324160:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 587us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.068114:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 238 00000100:00100000:3.0:1784938334.074588:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.079767:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125324416 00000100:00100000:0.0:1784938334.079860:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125324416 00000100:00100000:0.0:1784938334.080044:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:0.0:1784938334.080057:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+68:12468:x1871643125324416:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784938334.080179:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.080203:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.080241:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784938334.082416:0:13805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1784938334.082536:0:13805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088e5a416 reply state 00000000d968b8c0 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.082561:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.082572:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:0.0:1784938334.082575:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784938334.082580:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938334.082756:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+70:12468:x1871643125324416:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 2696us (8175us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1784938334.082766:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:2.0:1784938334.085641:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.088243:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125324544 00000100:00100000:1.0:1784938334.088265:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125324544 00000100:00100000:1.0:1784938334.088373:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00100000:1.0:1784938334.088385:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+70:12468:x1871643125324544:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938334.088437:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938334.088467:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289dc expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.088553:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289dc expref: 71 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.088572:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289dc expref: 71 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.088594:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:1.0:1784938334.088598:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938334.088602:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b800, rc 0) 00000100:00100000:1.0:1784938334.088699:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+71:12468:x1871643125324544:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 317us (3074us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.088706:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00100000:2.0:1784938334.092851:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.093815:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125324672 00000100:00100000:1.0:1784938334.093831:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125324672 00000100:00100000:1.0:1784938334.093927:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:1.0:1784938334.093940:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125324672:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784938334.096177:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:2393:x1871643125324672:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 2222us (3394us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1784938334.096194:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:2.0:1784938334.109196:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.109369:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125324928 00000100:00100000:0.0:1784938334.109383:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125324928 00000100:00100000:0.0:1784938334.109463:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:0.0:1784938334.109474:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+71:12468:x1871643125324928:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784938334.109810:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+72:12468:x1871643125324928:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 336us (628us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1784938334.109819:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:2.0:1784938334.112874:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938334.113703:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125325184 00000100:00100000:3.0:1784938334.113717:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125325184 00000100:00100000:3.0:1784938334.113859:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00100000:3.0:1784938334.113873:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+72:12468:x1871643125325184:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784938334.114041:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+72:12468:x1871643125325184:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 171us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938334.114049:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00100000:2.0:1784938334.124259:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.124373:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125325312 00000100:00100000:0.0:1784938334.124386:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125325312 00000100:00100000:0.0:1784938334.124491:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 242 00000100:00100000:0.0:1784938334.124502:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+72:12468:x1871643125325312:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938334.124642:0:13805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938334.124673:0:13805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef28f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289e3 expref: -99 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.124769:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef296 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.124787:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.124802:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938334.124861:0:13805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938334.124884:0:13805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.124919:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef28f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289e3 expref: 74 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.124943:0:13805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289e3 expref: 73 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.124976:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:0.0:1784938334.124979:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784938334.124984:0:13805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76600, rc 0) 00000100:00100000:0.0:1784938334.125068:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+73:12468:x1871643125325312:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 568us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938334.125075:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 242 00000100:00100000:2.0:1784938334.133179:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.138947:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125325440 00000100:00100000:1.0:1784938334.138972:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125325440 00000100:00100000:1.0:1784938334.139068:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:1.0:1784938334.139080:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+10:2393:x1871643125325440:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938334.139111:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938334.139143:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938334.139184:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63ff5d, blocks: 0x0 00010000:00010000:1.0:1784938334.139237:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1784938334.139243:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938334.139256:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ea expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.139279:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ea expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.139297:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215a200, rc 0) 00000100:00100000:1.0:1784938334.139726:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:2393:x1871643125325440:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 645us (6561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.139736:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:3.0:1784938334.142728:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.142969:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125325696 00000100:00100000:0.0:1784938334.142981:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125325696 00000100:00100000:0.0:1784938334.143051:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00100000:0.0:1784938334.143062:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+73:12468:x1871643125325696:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784938334.145420:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+73:12468:x1871643125325696:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 2329us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938334.145441:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00100000:2.0:1784938334.149994:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938334.153580:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125325824 00000100:00100000:3.0:1784938334.153605:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125325824 00000100:00100000:3.0:1784938334.153716:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:3.0:1784938334.153730:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:12468:x1871643125325824:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938334.153757:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938334.153805:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289f1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.153849:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ea expref: 12 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.153860:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938334.153865:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938334.153870:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.153920:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ea expref: 12 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.153939:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ea expref: 12 pid: 8429 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.153956:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8464a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1871643144256768:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938334.154104:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938334.160469:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.161040:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125325952 00000100:00100000:0.0:1784938334.161054:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125325952 00010000:00010000:0.0:1784938334.161120:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ea expref: 13 pid: 8429 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938334.161171:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:0.0:1784938334.161182:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:2392:x1871643125325952:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938334.161201:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938334.161262:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ea expref: 13 pid: 8429 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.161302:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ea expref: 13 pid: 8429 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.161336:0:9518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938334.161341:0:9518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938334.161351:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.161363:0:9518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.161431:0:9518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938334.161449:0:9518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9518:1871643144256896:192.168.203.26@tcp:105: 00000100:00100000:0.0:1784938334.161868:0:9518:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf863e40 going to sleep for 11 seconds 00010000:00010000:3.0:1784938334.162112:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef29d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ea expref: 13 pid: 8429 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.162133:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8464a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1871643144256768:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938334.162170:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.162206:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1600, rc 0) 00000100:00100000:3.0:1784938334.162288:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+12:12468:x1871643125325824:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 8561us (12309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938334.162299:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:0.0:1784938334.166664:0:9518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9518:1871643144256896:192.168.203.26@tcp:105: 00010000:00010000:0.0:1784938334.166702:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938334.166776:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:2392:x1871643125325952:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 5595us (6324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938334.166789:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:2.0:1784938334.169856:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.169944:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125326080 00000100:00100000:0.0:1784938334.169958:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125326080 00002000:00100000:0.0:1784938334.170023:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff910bc676f480 x1871643125326080/t0(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:565/0 lens 504/0 e 0 to 0 dl 1784938345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938334.170055:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc676f480 with x1871643125326080 ext(0->12) 00002000:00010000:0.0:1784938334.170062:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910bc676f480 00000100:00100000:0.0:1784938334.170105:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:0.0:1784938334.170116:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+11:2393:x1871643125326080:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784938334.172202:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:2393:x1871643125326080:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 2072us (2346us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1784938334.172254:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00002000:00100000:2.0:1784938334.172270:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff910bc676f480 x1871643125326080/t4294967321(0) o4->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:565/0 lens 504/448 e 0 to 0 dl 1784938345 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938334.172281:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910bc676f480 with x1871643125326080 ext(0->12) 00002000:00010000:2.0:1784938334.172289:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910bc676f480 00000100:00100000:2.0:1784938334.174999:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938334.175102:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125326208 00000100:00100000:3.0:1784938334.175115:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125326208 00000100:00100000:3.0:1784938334.175263:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 244 00000100:00100000:3.0:1784938334.175275:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+73:12468:x1871643125326208:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784938334.177402:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1784938334.177434:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:2.0:1784938334.177470:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1784938334.177496:0:6492:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910bc674dd80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1784938334.177501:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cfd706300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910bc674da80 00000020:00080000:2.0:1784938334.177505:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cfd706f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910bc84fe000 00000004:00080000:2.0:1784938334.177537:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1784938334.177563:0:6492:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910cf388ec00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1784938334.177565:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cfd60b000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910cfd5b70c0 00000020:00080000:2.0:1784938334.177568:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cfd60b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910bc752f800 00000100:00100000:3.0:1784938334.178058:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12468:x1871643125326208:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 2777us (3067us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938334.178072:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 244 00000020:00080000:1.0:1784938334.178257:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1784938334.178339:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1784938334.178419:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144257024:192.168.203.126@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938334.178508:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938334.178527:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144257152:192.168.203.126@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938334.178997:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938334.179072:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938334.179141:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144257024 00000100:00100000:2.0:1784938334.179150:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144257024 00000100:00100000:2.0:1784938334.179204:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144257152 00000100:00100000:2.0:1784938334.179208:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144257152 00000100:00100000:2.0:1784938334.179265:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 73 00000100:00100000:2.0:1784938334.179275:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1871643144257024:12345-192.168.203.126@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938334.179313:0:8770:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1784938334.179354:0:8770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a63ff5c, atime: 0x6a63ff5c, ctime: 0x6a63ff5c, blocks: 0x8 00010000:00010000:2.0:1784938334.179363:0:8770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.179382:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=402s v=(0 0) 00010000:00010000:2.0:1784938334.179398:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938334.179406:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.179424:0:8770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.179434:0:8770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.179442:0:8770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.179470:0:8770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938334.179611:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938334.179619:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.179629:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0c00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938334.179634:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.179644:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.179695:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.179712:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b8baa7c/0x26783cd1c59ef2ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.179736:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938334.179739:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938334.179741:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938334.179759:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 74 00000100:00100000:3.0:1784938334.179770:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144257152:12345-192.168.203.126@tcp:6:osp-syn-1-0.0 00002000:00080000:3.0:1784938334.179787:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1784938334.179881:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.179897:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28949 expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.179905:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1784938334.179908:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938334.179912:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.179957:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28949 expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.179987:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28949 expref: 12 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.180002:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8464000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1871643144257280:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938334.180086:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938334.183964:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3642:x1871643144257024:12345-192.168.203.126@tcp:6:osp-syn-0-0.0 Request processed in 4672us (4951us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784938334.183981:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 73 00000004:00080000:2.0:1784938334.184303:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910bc8464a80/2, rc 0, transno 4294967311 00000100:00100000:2.0:1784938334.184313:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144257024:192.168.203.126@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938334.184551:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8464000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8431:1871643144257280:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938334.184586:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.184673:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938334.186122:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125326336 00000100:00100000:3.0:1784938334.186140:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125326336 00010000:00010000:3.0:1784938334.186196:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28949 expref: 13 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.186276:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:3.0:1784938334.186288:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:2392:x1871643125326336:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938334.186308:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938334.186314:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28949 expref: 13 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.186330:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28949 expref: 13 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.186385:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb682d9/0x26783cd1c59ef05f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28949 expref: 13 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.186423:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938334.186429:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938334.186436:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.186448:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.186483:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:1.0:1784938334.186777:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1784938334.186793:0:8424:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1784938334.186878:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938334.187080:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125326464 00000100:00100000:2.0:1784938334.187086:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125326464 00000100:00100000:2.0:1784938334.187131:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:2.0:1784938334.187140:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:2392:x1871643125326464:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1784938334.187497:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187508:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187526:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187533:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938334.187539:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187556:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187572:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff910bc1795600) 00010000:00010000:0.0:1784938334.187575:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938334.187581:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187587:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0e00/0x26783cd1c59eefa9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187626:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187641:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187647:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187653:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938334.187656:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187662:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187671:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff910bc1799e00) 00010000:00010000:0.0:1784938334.187673:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938334.187676:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187683:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0800/0x26783cd1c59ef051 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187852:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187861:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187867:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187873:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215bc00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938334.187883:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187891:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187900:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:0.0:1784938334.187902:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938334.187905:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187911:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215bc00/0x26783cd1c59ef0cf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187927:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187933:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187938:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187944:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938334.187947:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187954:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187961:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc65fc900) 00010000:00010000:0.0:1784938334.187963:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938334.187972:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.187979:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef0f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188000:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188007:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188012:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188018:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938334.188020:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188025:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188034:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:0.0:1784938334.188036:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938334.188040:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188045:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1e00/0x26783cd1c59ef1c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188057:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188063:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188075:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188081:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938334.188083:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188089:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188098:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:0.0:1784938334.188100:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784938334.188103:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.188107:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef281 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.188665:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+13:2392:x1871643125326336:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 2370us (3983us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938334.188678:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 105 00010000:00010000:3.0:1784938334.188742:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.188755:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.188766:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.188774:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.188804:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938334.189071:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938334.189079:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.189088:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1400 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938334.189092:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.189101:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.189133:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.189141:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c74ca0e2/0x26783cd1c59ef2b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.189168:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938334.189170:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938334.189172:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784938334.195834:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1784938334.195871:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:3.0:1784938334.196301:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125326464:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 9151us (9412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938334.196317:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:2.0:1784938334.196413:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144257152:12345-192.168.203.126@tcp:6:osp-syn-1-0.0 Request processed in 16643us (17338us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1784938334.196422:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 74 00000100:00100000:1.0:1784938334.205574:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:1.0:1784938334.205591:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:1.0:1784938334.205660:0:3642:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff910cffb64000 x1871643144257152/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 544/432 e 0 to 0 dl 1784938350 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1784938334.205677:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910cffb64000/2, rc 0, transno 4294967322 00000100:00100000:1.0:1784938334.205790:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144257152:192.168.203.126@tcp:6:osp-syn-1-0.0 00000100:00100000:2.0:1784938334.210113:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.210324:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125326720 00000100:00100000:0.0:1784938334.210343:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125326720 00000100:00100000:0.0:1784938334.210445:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:0.0:1784938334.210457:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:12468:x1871643125326720:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784938334.210538:0:13805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938334.210575:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289e3 expref: 21 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.210602:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:0.0:1784938334.210609:0:13805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938334.210648:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.210664:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.210676:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938334.210874:0:13805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dda3cb8c reply state 000000009d16ddbb transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.210888:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.210895:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:0.0:1784938334.210898:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938334.210901:0:13805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938334.211061:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:12468:x1871643125326720:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 605us (956us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1784938334.211069:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:2.0:1784938334.214118:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.214283:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125326848 00000100:00100000:1.0:1784938334.214293:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125326848 00000100:00100000:1.0:1784938334.214386:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:1.0:1784938334.214412:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125326848:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784938334.214826:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784938334.214830:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1784938333 00002000:00010000:1.0:1784938334.214833:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1784938332 00002000:00010000:1.0:1784938334.214835:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1784938333 -> 1784938333 00002000:00010000:1.0:1784938334.214837:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1784938334.214901:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125326848:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 493us (791us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1784938334.214909:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:2.0:1784938334.217995:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.218619:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125327104 00000100:00100000:0.0:1784938334.218637:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125327104 00000100:00100000:0.0:1784938334.218750:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:0.0:1784938334.218763:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:12468:x1871643125327104:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784938334.218862:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.218897:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289d5 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.218910:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.218957:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289d5 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.219000:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289d5 expref: 22 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938334.219019:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144257408:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938334.219524:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf863240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938334.226272:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144257408:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938334.226320:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938334.230731:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.230830:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125327232 00000100:00100000:0.0:1784938334.230848:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125327232 00010000:00010000:0.0:1784938334.230914:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289d5 expref: 23 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938334.230973:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:0.0:1784938334.230985:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+23:2392:x1871643125327232:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938334.231008:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938334.231017:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289d5 expref: 23 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.231032:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289d5 expref: 23 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.231058:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b200/0x26783cd1c59ef27a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289d5 expref: 23 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.231177:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:0.0:1784938334.231184:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.231196:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.231205:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.231301:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938334.231378:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:2392:x1871643125327232:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 394us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938334.231396:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 106 00010000:00010000:3.0:1784938334.233371:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.233454:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.233641:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.233650:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.233658:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.233665:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938334.233669:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.233676:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.233693:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:3.0:1784938334.233696:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784938334.233701:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.233724:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.233811:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:12468:x1871643125327104:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 15047us (15820us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784938334.233821:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:3.0:1784938334.241921:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938334.242034:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125327360 00000100:00100000:2.0:1784938334.242052:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125327360 00000100:00100000:2.0:1784938334.242314:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:2.0:1784938334.242328:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2392:x1871643125327360:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784938334.242401:0:8770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.242458:0:8770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.242478:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938334.242483:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938334.242487:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.242537:0:8770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.242553:0:8770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 8 pid: 8430 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938334.242572:0:8770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1871643144257536:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938334.242680:0:8770:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938334.249191:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.250924:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125327488 00000100:00100000:1.0:1784938334.250947:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125327488 00010000:00010000:1.0:1784938334.251017:0:9518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 9 pid: 8430 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938334.251115:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 107 00000100:00100000:1.0:1784938334.251127:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125327488:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938334.251149:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938334.251183:0:9518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 9 pid: 8430 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.251198:0:9518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 9 pid: 8430 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.251271:0:9518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938334.251277:0:9518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938334.251285:0:9518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.251297:0:9518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.251324:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938334.251614:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+9:2393:x1871643125327488:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 290us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.251624:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 107 00010000:00010000:3.0:1784938334.254290:0:8770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef2a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f1 expref: 8 pid: 8430 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.254326:0:8770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1871643144257536:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938334.254362:0:8770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.254587:0:8770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.254599:0:8770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.254641:0:8770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.254650:0:8770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.254685:0:8770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.254694:0:8770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938334.254699:0:8770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.254710:0:8770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.254734:0:8770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.254743:0:8770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048279015/0x26783cd1c59ef2c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938334.254909:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125327360:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 12583us (12995us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938334.254920:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:0.0:1784938334.269488:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938334.269657:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125327744 00000100:00100000:3.0:1784938334.269673:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125327744 00000100:00100000:3.0:1784938334.269753:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:3.0:1784938334.269763:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:12468:x1871643125327744:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784938334.269837:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.269856:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2899d expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.269866:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.269915:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2899d expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.269928:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2899d expref: 21 pid: 6513 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.269943:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc8465500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144257664:192.168.203.26@tcp:104: 00000100:00100000:3.0:1784938334.270041:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d61a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938334.277600:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc8465500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144257664:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938334.277635:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938334.280545:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938334.280642:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125327872 00000100:00100000:3.0:1784938334.280651:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125327872 00010000:00010000:3.0:1784938334.280692:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2899d expref: 22 pid: 6513 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.280733:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 108 00000100:00100000:3.0:1784938334.280743:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:2392:x1871643125327872:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938334.280756:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938334.280763:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2899d expref: 22 pid: 6513 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.280775:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2899d expref: 22 pid: 6513 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.280823:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59ef1bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2899d expref: 22 pid: 6513 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.280841:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938334.280847:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c0 expref: 21 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.280857:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.280865:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.280872:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938334.280911:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938334.280964:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:2392:x1871643125327872:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 222us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938334.280971:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 108 00010000:00010000:1.0:1784938334.281898:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.281911:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.282089:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.282104:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289dc expref: 21 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.282113:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.282145:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289dc expref: 21 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.282158:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289dc expref: 21 pid: 9526 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938334.282172:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144257792:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938334.282284:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc73826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938334.286599:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938334.286982:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125328000 00000100:00100000:2.0:1784938334.286993:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125328000 00010000:00010000:2.0:1784938334.287029:0:7921:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289dc expref: 22 pid: 9526 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938334.287076:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 109 00000100:00100000:2.0:1784938334.287084:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:2393:x1871643125328000:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938334.287099:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938334.287106:0:7921:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289dc expref: 22 pid: 9526 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.287133:0:7921:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289dc expref: 22 pid: 9526 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.287155:0:7921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:2.0:1784938334.287160:0:7921:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.287170:0:7921:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.287178:0:7921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.287195:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938334.287279:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:2393:x1871643125328000:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 195us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938334.287287:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 109 00010000:00010000:1.0:1784938334.288481:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef288 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289dc expref: 21 pid: 9526 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938334.288521:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144257792:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938334.288541:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.288559:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.288567:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938334.288699:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1784938334.288821:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1784938334.288859:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1784938334.288941:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1871643144257920:192.168.203.126@tcp:1000:mdt00_002.0 00000100:00100000:1.0:1784938334.289009:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938334.289425:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938334.289772:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144257920 00000100:00100000:1.0:1784938334.289779:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144257920 00000100:00100000:1.0:1784938334.289826:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 213 00000100:00100000:1.0:1784938334.289835:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6514:x1871643144257920:12345-192.168.203.126@tcp:1000:mdt00_002.0 00000100:00100000:1.0:1784938334.289925:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6514:x1871643144257920:12345-192.168.203.126@tcp:1000:mdt00_002.0 Request processed in 91us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.289933:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 213 00000100:00100000:1.0:1784938334.290363:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1871643144257920:192.168.203.126@tcp:1000:mdt00_002.0 00000001:00080000:1.0:1784938334.290787:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1784938334.290850:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1871643144258048:192.168.203.126@tcp:1000:mdt00_002.0 00000100:00100000:1.0:1784938334.290947:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938334.291562:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938334.291613:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144258048 00000100:00100000:1.0:1784938334.291620:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144258048 00000100:00100000:1.0:1784938334.291669:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 214 00000100:00100000:1.0:1784938334.291677:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6514:x1871643144258048:12345-192.168.203.126@tcp:1000:mdt00_002.0 00000100:00100000:1.0:1784938334.292099:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6514:x1871643144258048:12345-192.168.203.126@tcp:1000:mdt00_002.0 Request processed in 420us (547us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1784938334.292108:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 214 00000100:00100000:1.0:1784938334.292426:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1871643144258048:192.168.203.126@tcp:1000:mdt00_002.0 00010000:00010000:1.0:1784938334.292497:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292508:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292525:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292532:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938334.292537:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292544:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292731:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:1.0:1784938334.292734:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938334.292740:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292746:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b600/0x26783cd1c59ef2d5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292770:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292777:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292782:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292798:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ba00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938334.292801:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292807:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292816:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938334.292819:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938334.292824:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c0 expref: 24 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292834:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c0 expref: 24 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292843:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c0 expref: 24 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.292875:0:6514:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c0 expref: 24 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938334.292888:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144258176:192.168.203.26@tcp:105: 00000100:00100000:1.0:1784938334.292943:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938334.297723:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.297825:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1871643144258176:192.168.203.26@tcp:105: 00010000:00010000:1.0:1784938334.297853:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297881:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ba00/0x26783cd1c59ef218 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297915:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297930:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297941:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297953:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297960:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297967:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297974:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938334.297978:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297986:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.297996:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938334.297999:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938334.298001:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.298012:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215b800/0x26783cd1c59ef2dc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.298023:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.298029:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.298034:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.298039:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938334.298043:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.298048:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.298055:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938334.298057:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784938334.298060:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.298065:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1600/0x26783cd1c59ef2ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938334.298255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:12468:x1871643125327744:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 28491us (28791us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1784938334.298265:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 247 00000020:00080000:1.0:1784938334.298276:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1784938334.298429:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125328128 00000100:00100000:0.0:1784938334.298436:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125328128 00000100:00100000:0.0:1784938334.298497:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:0.0:1784938334.298507:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:12467:x1871643125328128:12345-192.168.203.26@tcp:49:lfs.0 00000100:00100000:0.0:1784938334.298614:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:12467:x1871643125328128:12345-192.168.203.26@tcp:49:lfs.0 Request processed in 109us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938334.298622:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000040:00080000:2.0:1784938334.298859:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938334.298864:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784938334.299383:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1784938334.299589:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784938334.309158:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938334.309209:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.309589:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125328384 00000100:00100000:1.0:1784938334.309599:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125328384 00000100:00100000:1.0:1784938334.309654:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 248 00000100:00100000:1.0:1784938334.309664:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:12467:x1871643125328384:12345-192.168.203.26@tcp:58:lfs.0 00000040:00080000:1.0:1784938334.309830:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1784938334.309918:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:12467:x1871643125328384:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 255us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.309926:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 248 00000100:00100000:0.0:1784938334.311756:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125328640 00000100:00100000:0.0:1784938334.311768:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125328640 00000100:00100000:0.0:1784938334.311866:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:0.0:1784938334.311878:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+24:12468:x1871643125328640:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784938334.312113:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784938334.312148:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1784938334.312180:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.312196:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.312207:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.312234:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.312241:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.312247:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.312273:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938334.314872:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938334.314888:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.314898:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938334.314915:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.314924:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.314940:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:2.0:1784938334.314943:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784938334.314948:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.314954:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2e3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938334.314974:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938334.314976:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938334.314978:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938334.315668:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:12468:x1871643125328640:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 3785us (6449us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1784938334.315680:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000020:00080000:0.0:1784938334.315688:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784938334.350951:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.351076:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125328768 00000100:00100000:0.0:1784938334.351085:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125328768 00000100:00100000:0.0:1784938334.351145:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:0.0:1784938334.351154:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+26:12470:x1871643125328768:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938334.351183:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938334.351207:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289f8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351310:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351325:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351335:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351347:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351354:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351359:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351456:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351479:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b9 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351654:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351687:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b9 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.351701:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b9 expref: 27 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938334.351714:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144258304:192.168.203.26@tcp:104: 00000100:00100000:0.0:1784938334.351797:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdf863f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938334.355619:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1871643144258304:192.168.203.26@tcp:104: 00010000:00010000:0.0:1784938334.355649:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938334.357077:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938334.357169:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125329024 00000100:00100000:1.0:1784938334.357179:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125329024 00000100:00100000:1.0:1784938334.357271:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:1.0:1784938334.357281:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:6164:x1871643125329024:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784938334.357514:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:6164:x1871643125329024:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 233us (444us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1784938334.357522:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:3.0:1784938334.361057:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938334.361383:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125329152 00000100:00100000:0.0:1784938334.361448:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125329152 00010000:00010000:0.0:1784938334.361490:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b9 expref: 29 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938334.361664:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 110 00000100:00100000:0.0:1784938334.361676:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8466680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:2393:x1871643125329152:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938334.361693:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938334.361716:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b9 expref: 29 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.361728:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b9 expref: 29 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.361751:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59ef20a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289b9 expref: 29 pid: 6512 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.361768:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:0.0:1784938334.361774:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.361783:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.361791:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938334.361817:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938334.361928:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8466680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:2393:x1871643125329152:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 253us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938334.361936:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 110 00010000:00010000:1.0:1784938334.362002:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362010:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938334.362059:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784938334.362064:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938334.362083:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362095:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362115:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362121:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362127:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362133:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938334.362137:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362144:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362153:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:1.0:1784938334.362156:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938334.362159:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362169:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef2f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362181:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362188:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362194:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362204:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938334.362207:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362246:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362254:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff910bc1799e00) 00010000:00010000:1.0:1784938334.362256:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938334.362259:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362264:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef2f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362299:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77e00/0x26783cd1c59ef2ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f8 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362314:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f8 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938334.362322:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938334.362325:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938334.362327:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76000, rc 0) 00000100:00100000:1.0:1784938334.362367:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12470:x1871643125328768:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 11214us (11424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.362374:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 249 00010000:00010000:0.0:1784938334.818677:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938334.879381:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144258432:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938334.879638:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938334.879666:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144258432 00000100:00100000:2.0:1784938334.879673:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144258432 00000100:00100000:2.0:1784938334.879724:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 158 00000100:00100000:2.0:1784938334.879732:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144258432:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938334.879753:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1784938334.879792:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144258432:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 60us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938334.879799:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 158 00000100:00100000:2.0:1784938334.879940:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1784938334.879947:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1784938334.879989:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910cffb56d80, transno 4294967308 00000004:00080000:2.0:1784938334.880002:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1784938334.880016:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910bc8464a80, transno 4294967311 00000100:00100000:2.0:1784938334.880027:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144258432:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938334.883679:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938334.884121:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144258560:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938334.884464:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938334.886657:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144258560 00000100:00100000:2.0:1784938334.886670:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144258560 00000100:00100000:2.0:1784938334.886729:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 159 00000100:00100000:2.0:1784938334.886739:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc8464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144258560:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938334.886762:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1784938334.886829:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc8464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144258560:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 91us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938334.886836:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 159 00000100:00100000:2.0:1784938334.888814:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144258560:192.168.203.126@tcp:13:osp-pre-0-1.0 00000040:00080000:1.0:1784938335.198994:0:14707:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938335.199015:0:14707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938335.199049:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784938335.199056:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1784938335.327700:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938335.327712:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938335.327740:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784938335.327751:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784938335.327879:0:13794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144258688:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784938335.327985:0:13794:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938335.337952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938335.338016:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125329280 00000100:00100000:0.0:1784938335.338025:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125329280 00000100:00100000:3.0:1784938335.338039:0:13794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1871643144258688:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784938335.338088:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:0.0:1784938335.338097:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12482:x1871643125329280:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784938335.338151:0:6514:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784938335.338281:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12482:x1871643125329280:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 184us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938335.338288:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:2.0:1784938335.352445:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938335.352542:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125329536 00000100:00100000:1.0:1784938335.352552:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125329536 00000100:00100000:1.0:1784938335.352606:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 251 00000100:00100000:1.0:1784938335.352615:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+27:12482:x1871643125329536:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938335.352635:0:9526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938335.352656:0:9526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef306 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a289ff expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.352759:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef30d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.352774:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef30d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.352788:0:9526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef30d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938335.352798:0:9526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784938335.352900:0:9526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215a200/0x26783cd1c59ef306 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ff expref: 30 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.352932:0:9526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef30d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ff expref: 29 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.352941:0:9526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938335.352943:0:9526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938335.352947:0:9526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215ae00, rc 0) 00000100:00100000:1.0:1784938335.353007:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:12482:x1871643125329536:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 394us (571us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1784938335.353015:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 251 00000100:00100000:3.0:1784938335.357018:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938335.357106:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125329920 00000100:00100000:2.0:1784938335.357116:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125329920 00000100:00100000:2.0:1784938335.357192:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:2.0:1784938335.357203:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:2395:x1871643125329920:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938335.357235:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938335.357260:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d0215ae00/0x26783cd1c59ef30d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289ff expref: 29 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.357278:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938335.357283:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938335.357330:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:2395:x1871643125329920:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 130us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938335.357345:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:2.0:1784938335.357753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938335.357811:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125329792 00000100:00100000:3.0:1784938335.357817:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125329792 00000100:00100000:3.0:1784938335.357854:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 252 00000100:00100000:3.0:1784938335.357861:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+28:12482:x1871643125329792:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784938335.357927:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.357941:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.357951:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.358754:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.358764:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.358771:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.358777:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938335.358780:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.358789:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.358800:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938335.358808:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784938335.358813:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.358819:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef31b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938335.358941:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:12482:x1871643125329792:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 1078us (1186us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1784938335.358949:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 252 00000040:00080000:2.0:1784938335.359820:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938335.359826:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784938335.362363:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1784938335.362379:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938335.372942:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938335.373343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125330176 00000100:00100000:3.0:1784938335.373353:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125330176 00000100:00100000:3.0:1784938335.373455:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1784938335.373466:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+29:12482:x1871643125330176:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784938335.373686:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:12482:x1871643125330176:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 222us (750us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1784938335.373695:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00010000:00010000:0.0:1784938335.840351:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938335.904698:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938335.904728:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144258816:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938335.906067:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938335.906150:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144258816 00000100:00100000:1.0:1784938335.906158:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144258816 00000100:00100000:1.0:1784938335.906247:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 215 00000100:00100000:1.0:1784938335.906258:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144258816:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:1.0:1784938335.906294:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1784938335.906347:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144258816:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938335.906354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 215 00000100:00100000:1.0:1784938335.907021:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144258816:192.168.203.126@tcp:41:osp-pre-0-1.0 00000040:00080000:2.0:1784938335.968067:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784938336.874456:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938337.030060:0:14759:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938337.030071:0:14759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938337.030102:0:14759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784938337.030110:0:14759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784938337.218508:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938337.218567:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125330432 00000100:00100000:2.0:1784938337.218576:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125330432 00000100:00100000:2.0:1784938337.218653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00100000:2.0:1784938337.218663:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+30:12503:x1871643125330432:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938337.218688:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938337.218711:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0200/0x26783cd1c59ef322 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28a06 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.218822:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef329 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.218838:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef329 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.218851:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef329 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938337.218862:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784938337.218962:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0200/0x26783cd1c59ef322 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a06 expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.218998:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a06 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.219007:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938337.219010:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784938337.219012:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0000, rc 0) 00000100:00100000:2.0:1784938337.219073:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:12503:x1871643125330432:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 412us (572us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1784938337.219081:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00080000:0.0:1784938337.219169:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938337.224721:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938337.224788:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125330560 00000100:00100000:3.0:1784938337.224797:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125330560 00000100:00100000:3.0:1784938337.224852:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:3.0:1784938337.224861:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:12503:x1871643125330560:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1784938337.224920:0:13805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938337.224937:0:13805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938337.224948:0:13805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938337.225000:0:13805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938337.225008:0:13805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938337.225015:0:13805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938337.225022:0:13805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938337.225026:0:13805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938337.225033:0:13805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938337.225045:0:13805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938337.225048:0:13805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938337.225052:0:13805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938337.225059:0:13805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938337.226246:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:12503:x1871643125330560:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 1376us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938337.226258:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:3.0:1784938337.341566:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938337.341722:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125330688 00000100:00100000:2.0:1784938337.341732:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125330688 00000100:00100000:2.0:1784938337.341807:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:2.0:1784938337.341818:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2395:x1871643125330688:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1784938337.341837:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938337.341859:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a8660a7/0x26783cd1c59ef33e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28a0d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938337.341883:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a63ff5d, atime: 0x6a63ff5c, ctime: 0x6a63ff5d, blocks: 0x8 00010000:00010000:2.0:1784938337.341903:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=405s v=(0 0) 00010000:00010000:2.0:1784938337.341907:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938337.341916:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a8660a7/0x26783cd1c59ef33e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a0d expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.341934:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a8660a7/0x26783cd1c59ef33e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a0d expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.341961:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0200, rc 0) 00000100:00100000:2.0:1784938337.342024:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2395:x1871643125330688:12345-192.168.203.26@tcp:101:cat.0 Request processed in 208us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938337.342032:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00080000:0.0:1784938337.342433:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938337.350662:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938337.350794:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125330816 00000100:00100000:2.0:1784938337.350803:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125330816 00002000:00100000:2.0:1784938337.350851:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff910cffb76a00 x1871643125330816/t0(0) o3->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:568/0 lens 488/0 e 0 to 0 dl 1784938348 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938337.350862:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cffb76a00 with x1871643125330816 ext(0->4095) 00002000:00010000:2.0:1784938337.350867:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910cffb76a00 00000100:00100000:2.0:1784938337.350898:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1784938337.350906:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2393:x1871643125330816:12345-192.168.203.26@tcp:3:cat.0 00000100:00100000:2.0:1784938337.351075:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2393:x1871643125330816:12345-192.168.203.26@tcp:3:cat.0 Request processed in 169us (421us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784938337.351083:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00002000:00100000:2.0:1784938337.351090:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff910cffb76a00 x1871643125330816/t0(0) o3->263deb07-6496-49f7-9596-7a44f1bd8c2b@192.168.203.26@tcp:568/0 lens 488/4536 e 0 to 0 dl 1784938348 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938337.351098:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff910cffb76a00 with x1871643125330816 ext(0->4095) 00002000:00010000:2.0:1784938337.351101:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910cffb76a00 00000100:00100000:1.0:1784938337.440758:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144258944:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938337.443737:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938337.443892:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144258944 00000100:00100000:1.0:1784938337.443902:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144258944 00000100:00100000:1.0:1784938337.443969:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 216 00000100:00100000:1.0:1784938337.443980:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144258944:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938337.444022:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938337.444097:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144258944:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 119us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938337.444104:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 216 00000100:00100000:1.0:1784938337.444560:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144258944:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938337.890750:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938338.918208:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938338.938924:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938338.938963:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938338.938987:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938338.939014:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938338.939035:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938338.939053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938338.939091:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938338.939123:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125331328 00000100:00100000:1.0:1784938338.939134:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125331328 00000100:00100000:3.0:1784938338.939195:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125331072 00000100:00100000:3.0:1784938338.939207:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125331072 00000100:00100000:1.0:1784938338.939244:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125331456 00000100:00100000:1.0:1784938338.939249:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125331456 00000100:00100000:3.0:1784938338.939267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125331584 00000100:00100000:3.0:1784938338.939272:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125331584 00000100:00100000:1.0:1784938338.939282:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:3.0:1784938338.939294:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125331200 00000100:00100000:1.0:1784938338.939294:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125331328:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.939299:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125331200 00000100:00100000:3.0:1784938338.939316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125331712 00000100:00100000:3.0:1784938338.939319:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125331712 00000100:00100000:3.0:1784938338.939335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 368 00000100:00100000:3.0:1784938338.939344:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:2394:x1871643125331072:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938338.939383:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125331328:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 91us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938338.939391:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:1.0:1784938338.939409:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:1.0:1784938338.939425:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2394:x1871643125331456:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938338.939454:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+8:2394:x1871643125331456:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938338.939460:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:1.0:1784938338.939482:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 369 00000100:00100000:1.0:1784938338.939489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125331584:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938338.939515:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125331584:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938338.939520:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 369 00000100:00100000:1.0:1784938338.939533:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 370 00000100:00100000:1.0:1784938338.939539:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125331200:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938338.939562:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2394:x1871643125331200:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938338.939569:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 370 00000100:00100000:1.0:1784938338.939580:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 371 00000100:00100000:1.0:1784938338.939586:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125331712:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938338.939607:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2394:x1871643125331712:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 21us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938338.939612:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 371 00000100:00100000:1.0:1784938338.939630:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125330944 00000100:00100000:1.0:1784938338.939633:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125330944 00000100:00100000:1.0:1784938338.939658:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 400 00000100:00100000:1.0:1784938338.939663:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2394:x1871643125330944:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938338.939697:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2394:x1871643125330944:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938338.939704:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 400 00000100:00080000:1.0:1784938338.939994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938338.939999:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938338.940003:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938338.941707:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+32:2394:x1871643125331072:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 2344us (2774us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938338.941722:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 368 00000100:00100000:2.0:1784938338.975635:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144259456:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.975751:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144259968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.975795:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144260480:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.975832:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784938338.975840:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144259328:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.975862:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144259840:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938338.975863:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144259072:0@lo:400:kworker.0 00000100:00100000:2.0:1784938338.975884:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144260352:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938338.975921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938338.975959:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144259584:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938338.976122:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144260096:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938338.976149:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144260608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.976165:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144259200:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938338.976194:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144259072 00000100:00100000:0.0:1784938338.976201:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144259072 00000100:00100000:3.0:1784938338.976205:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffc34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144259712:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938338.976269:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1784938338.976273:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144260224:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938338.976282:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144259072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938338.976336:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144259072:12345-0@lo:400:kworker.0 Request processed in 58us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938338.976342:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1784938338.976461:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976502:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976534:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976761:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976798:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976855:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976906:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976925:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976943:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976958:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976974:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.976989:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938338.977007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144259328 00000100:00100000:2.0:1784938338.977011:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144259328 00000100:00100000:3.0:1784938338.977111:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144259456 00000100:00100000:3.0:1784938338.977115:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144259456 00000100:00100000:3.0:1784938338.977136:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144259840 00000100:00100000:3.0:1784938338.977138:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144259840 00000100:00100000:3.0:1784938338.977156:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144259200 00000100:00100000:3.0:1784938338.977158:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144259200 00000100:00100000:3.0:1784938338.977167:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144260352 00000100:00100000:3.0:1784938338.977169:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144260352 00000100:00100000:3.0:1784938338.977181:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144260224 00000100:00100000:3.0:1784938338.977183:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144260224 00000100:00100000:3.0:1784938338.977193:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144259712 00000100:00100000:3.0:1784938338.977195:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144259712 00000100:00100000:3.0:1784938338.977207:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 372 00000100:00100000:3.0:1784938338.977245:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144259456:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.977298:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144259456:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 85us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938338.977306:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 372 00000100:00100000:3.0:1784938338.977322:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 373 00000100:00100000:3.0:1784938338.977329:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144259840:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.977355:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144259840:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938338.977370:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 373 00000100:00100000:3.0:1784938338.977382:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 374 00000100:00100000:3.0:1784938338.977388:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144259200:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.977411:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144259200:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938338.977418:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 374 00000100:00100000:3.0:1784938338.977429:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 375 00000100:00100000:3.0:1784938338.977435:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144260352:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.977455:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144260352:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938338.977460:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 375 00000100:00100000:3.0:1784938338.977470:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 376 00000100:00100000:3.0:1784938338.977477:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144260224:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.977499:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144260224:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938338.977504:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 376 00000100:00100000:3.0:1784938338.977522:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 377 00000100:00100000:3.0:1784938338.977529:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144259712:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.977566:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144259712:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 38us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938338.977572:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 377 00000100:00080000:3.0:1784938338.977589:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938338.977592:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938338.977605:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144260736:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938338.977737:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144259584 00000100:00100000:2.0:1784938338.977742:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144259584 00000100:00100000:2.0:1784938338.977761:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 217 00000100:00100000:2.0:1784938338.977767:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144259328:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.977796:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144259328:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 30us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938338.977812:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 217 00000100:00100000:2.0:1784938338.977826:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 218 00000100:00100000:2.0:1784938338.977832:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144259584:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.977855:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144259584:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938338.977862:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 218 00000100:00100000:2.0:1784938338.977890:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144259968 00000100:00100000:2.0:1784938338.977893:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144259968 00000100:00100000:2.0:1784938338.977922:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144260480 00000100:00100000:2.0:1784938338.977925:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144260480 00000100:00100000:2.0:1784938338.977939:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144260096 00000100:00100000:2.0:1784938338.977941:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144260096 00000100:00100000:2.0:1784938338.977957:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144260608 00000100:00100000:2.0:1784938338.977960:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144260608 00000100:00100000:2.0:1784938338.977975:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 149 00000100:00100000:2.0:1784938338.977981:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144259968:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.978004:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144259968:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938338.978011:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 149 00000100:00100000:0.0:1784938338.978025:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144259072:0@lo:400:kworker.0 00000100:00100000:2.0:1784938338.978026:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 150 00000100:00100000:2.0:1784938338.978048:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144260480:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.978067:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144260480:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938338.978073:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 150 00000100:00100000:2.0:1784938338.978085:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 151 00000004:00080000:1.0:1784938338.978193:0:9814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407009976798ns, next at 408009974379ns, rc = 0 00000100:00100000:1.0:1784938338.978233:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144260864:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938338.978435:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 152 00000100:00100000:0.0:1784938338.978579:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1871643144260608:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938338.978613:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1871643144260608:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 171us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938338.978621:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 152 00000100:00100000:2.0:1784938338.978704:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144260096:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.978848:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144260096:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 749us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938338.978855:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 151 00000100:00080000:2.0:1784938338.978873:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938338.978878:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938338.978907:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144259456:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.978918:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144259968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938338.979075:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:2.0:1784938338.979194:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffc37800 x1871643144259840/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938338.979240:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144259840:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.979255:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144260480:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938338.979913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938338.979982:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144259328:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938338.979995:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd730380 x1871643144260352/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938338.980005:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144260352:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.980121:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144260864 00000100:00100000:2.0:1784938338.980128:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144260864 00000100:00100000:2.0:1784938338.980169:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144260736 00000100:00100000:2.0:1784938338.980172:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144260736 00000100:00100000:2.0:1784938338.980198:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 160 00000100:00100000:2.0:1784938338.980206:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1871643144260864:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938338.980255:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784938338.980307:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1871643144260864:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 101us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938338.980314:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 160 00000100:00100000:2.0:1784938338.980331:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 161 00000100:00100000:2.0:1784938338.980338:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144260736:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938338.980370:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784938338.980392:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144260736:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 54us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938338.980398:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 161 00000100:00100000:0.0:1784938338.980875:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144259584:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938338.980932:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144260864:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938338.980968:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144260096:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938338.980985:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144260608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.981168:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144259200:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.981182:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffc34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144259712:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.981267:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144260224:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938338.981298:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144260736:192.168.203.126@tcp:13:osp-pre-1-1.0 00010000:00010000:1.0:1784938339.947728:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938340.000743:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938340.000781:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144260992:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938340.002390:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938340.003324:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938340.003361:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144261120:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938340.003671:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938340.003734:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144260992 00000100:00100000:1.0:1784938340.003743:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144260992 00000100:00100000:1.0:1784938340.003820:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144261120 00000100:00100000:1.0:1784938340.003823:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144261120 00000100:00100000:1.0:1784938340.003849:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 162 00000100:00100000:1.0:1784938340.003860:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144260992:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938340.003899:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938340.003957:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144260992:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 98us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938340.003965:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 162 00000100:00100000:1.0:1784938340.004008:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 163 00000100:00100000:1.0:1784938340.004015:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144261120:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938340.004026:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938340.004057:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144261120:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 42us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938340.004064:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 163 00000100:00080000:0.0:1784938340.004099:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938340.004456:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144261120:192.168.203.126@tcp:13:osp-pre-0-1.0 00000001:00080000:3.0:1784938340.005788:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1784938340.005804:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:3.0:1784938340.005896:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144260992:192.168.203.126@tcp:13:osp-pre-0-0.0 00000004:00080000:2.0:1784938340.009200:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:2.0:1784938340.009277:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1784938340.009315:0:6492:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910bc7382180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1784938340.009321:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cc963cf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910bc7382f00 00000020:00080000:2.0:1784938340.009325:0:6492:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff910cc963ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910bc7f28400 00000020:00080000:2.0:1784938340.009347:0:6492:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1784938340.009379:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1784938340.009477:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1784938340.009498:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938340.009515:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938340.009525:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938340.009535:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938340.009547:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938340.009567:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938340.009681:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938340.009715:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144261248:192.168.203.126@tcp:2:osp-syn-1-0.0 00010000:00010000:3.0:1784938340.009866:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff910bc65fce00) 00010000:00010000:3.0:1784938340.009870:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938340.009876:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938340.009882:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77800/0x26783cd1c59ef2b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938340.010077:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938340.010112:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144261248 00000100:00100000:1.0:1784938340.010121:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144261248 00000100:00100000:1.0:1784938340.010190:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 79 00000100:00100000:1.0:1784938340.010201:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144261248:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 00002000:00010000:1.0:1784938340.010407:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1784938340.010411:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1784938333 -> 1784938333 00002000:00010000:1.0:1784938340.010414:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1784938332 -> 1784938332 00002000:00010000:1.0:1784938340.010417:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1784938333 -> 1784938333 00002000:00010000:1.0:1784938340.010420:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1784938340.010470:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1871643144261248:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 Request processed in 269us (392us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1784938340.010479:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 79 00000100:00080000:1.0:1784938340.010507:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938340.010598:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1784938340.010605:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910cffb64000, transno 4294967322 00000004:00080000:1.0:1784938340.010641:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1784938340.010672:0:3640:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff910bc7cc8a80 x1871643144261248/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 440/432 e 0 to 0 dl 1784938356 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1784938340.010686:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910bc7cc8a80/2, rc 0, transno 4294967325 00000100:00100000:1.0:1784938340.010692:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144261248:192.168.203.126@tcp:2:osp-syn-1-0.0 00010000:00010000:0.0:1784938340.959699:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938341.025091:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144261376:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938341.035419:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938341.035469:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144261376 00000100:00100000:2.0:1784938341.035489:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144261376 00000100:00100000:2.0:1784938341.038065:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 219 00000100:00100000:0.0:1784938341.038131:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144261376:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938341.038176:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1784938341.038288:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144261376:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 209us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938341.038296:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 219 00000100:00100000:1.0:1784938341.043917:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144261376:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938341.987760:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938342.030922:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938342.031006:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125331840 00000100:00100000:3.0:1784938342.031020:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125331840 00000100:00100000:3.0:1784938342.031584:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00100000:3.0:1784938342.031598:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:12156:x1871643125331840:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784938342.031734:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:12156:x1871643125331840:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 140us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938342.031743:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00080000:0.0:1784938342.032062:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938342.033676:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938342.033784:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125331968 00000100:00100000:1.0:1784938342.033796:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125331968 00000100:00100000:1.0:1784938342.033874:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00100000:1.0:1784938342.033887:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:12156:x1871643125331968:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1784938342.033922:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938342.034020:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:12156:x1871643125331968:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 135us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938342.034029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00100000:2.0:1784938342.041827:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938342.041909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125332224 00000100:00100000:3.0:1784938342.041923:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125332224 00000100:00100000:3.0:1784938342.042000:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:3.0:1784938342.042015:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:12156:x1871643125332224:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784938342.044715:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:12156:x1871643125332224:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 1089us (1288us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1784938342.044734:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:0.0:1784938342.287915:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938342.288325:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125332352 00000100:00100000:3.0:1784938342.288402:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125332352 00000100:00100000:3.0:1784938342.288544:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 257 00000100:00100000:3.0:1784938342.288555:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:12960:x1871643125332352:12345-192.168.203.26@tcp:101:lsof.0 00010000:00010000:3.0:1784938342.288583:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938342.288611:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef345 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28a14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938342.288691:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef34c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938342.288709:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef34c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938342.288724:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef34c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938342.288798:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784938342.288803:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938342.288828:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef34c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938342.288857:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59ef345 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a14 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938342.288880:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef34c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a14 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938342.288889:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19a00) 00010000:00010000:3.0:1784938342.288893:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938342.288916:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1c00, rc 0) 00000100:00080000:0.0:1784938342.289076:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938342.290100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:12960:x1871643125332352:12345-192.168.203.26@tcp:101:lsof.0 Request processed in 1538us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938342.290112:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 257 00000100:00100000:1.0:1784938342.559732:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144261504:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938342.562595:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938342.562644:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144261504 00000100:00100000:0.0:1784938342.562655:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144261504 00000100:00100000:0.0:1784938342.562714:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 220 00000100:00100000:0.0:1784938342.562726:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144261504:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938342.562775:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784938342.562856:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144261504:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 133us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938342.562865:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 220 00000100:00100000:1.0:1784938342.563804:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144261504:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:1.0:1784938343.007527:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938344.031799:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938344.063872:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938344.063930:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938344.063976:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938344.064018:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938344.064047:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938344.064112:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125332736 00000100:00100000:2.0:1784938344.064126:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125332736 00000100:00100000:2.0:1784938344.064198:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125333248 00000100:00100000:2.0:1784938344.064202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125333248 00000100:00100000:2.0:1784938344.064264:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125332608 00000100:00100000:2.0:1784938344.064267:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125332608 00000100:00100000:2.0:1784938344.064291:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 378 00000100:00100000:2.0:1784938344.064303:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125332736:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.064426:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125332736:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 126us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938344.064435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 378 00000100:00100000:2.0:1784938344.064456:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 379 00000100:00100000:2.0:1784938344.064463:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125333248:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.064489:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2392:x1871643125333248:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938344.064497:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 379 00000100:00100000:2.0:1784938344.064510:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 380 00000100:00100000:2.0:1784938344.064517:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:2392:x1871643125332608:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.064569:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:2392:x1871643125332608:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 52us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938344.064576:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 380 00000100:00100000:3.0:1784938344.065192:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125332992 00000100:00100000:3.0:1784938344.065199:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125332992 00000100:00100000:3.0:1784938344.065294:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00100000:3.0:1784938344.065304:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125332992:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.065370:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2392:x1871643125332992:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 68us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938344.065382:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00100000:1.0:1784938344.065725:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125332480 00000100:00100000:1.0:1784938344.065732:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125332480 00000100:00100000:1.0:1784938344.065768:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 402 00000100:00100000:1.0:1784938344.065775:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125332480:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938344.065809:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2392:x1871643125332480:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938344.065830:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 402 00000100:00100000:3.0:1784938344.066238:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938344.066305:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938344.066340:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125332864 00000100:00100000:3.0:1784938344.066345:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125332864 00000100:00100000:3.0:1784938344.066394:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:3.0:1784938344.066415:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125332864:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.066459:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2392:x1871643125332864:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 57us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938344.066466:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:3.0:1784938344.066507:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125333120 00000100:00100000:3.0:1784938344.066512:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125333120 00000100:00100000:3.0:1784938344.067274:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 381 00000100:00100000:3.0:1784938344.067287:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2392:x1871643125333120:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:0.0:1784938344.067607:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938344.067615:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938344.067619:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938344.067621:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938344.067922:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2392:x1871643125333120:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 635us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938344.067949:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 381 00000100:00100000:1.0:1784938344.095970:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144261632:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938344.096633:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.096841:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144261632 00000100:00100000:0.0:1784938344.096853:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144261632 00000100:00100000:0.0:1784938344.096941:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 164 00000100:00100000:0.0:1784938344.096953:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144261632:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938344.096993:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784938344.097054:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144261632:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 103us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938344.097062:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 164 00000100:00100000:0.0:1784938344.097291:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144261632:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938344.097689:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144262016:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938344.097759:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144262528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938344.097792:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144263040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938344.097819:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784938344.097825:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144261888:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938344.097848:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144262400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938344.097870:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144262912:192.168.203.126@tcp:400:kworker.0 00000100:00080000:2.0:1784938344.098046:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938344.098107:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144261760:0@lo:400:kworker.0 00000100:00100000:0.0:1784938344.098161:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938344.098674:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144262272:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938344.098723:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144262784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938344.098756:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144263296:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938344.098781:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784938344.098788:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144262144:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938344.098814:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144262656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938344.098835:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144263168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938344.099121:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.099205:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.099256:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.099273:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.099290:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.099306:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.099321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.099363:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.099382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.099402:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938344.099690:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938344.099747:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144262528 00000100:00100000:2.0:1784938344.099757:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144262528 00000100:00100000:2.0:1784938344.099825:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144263040 00000100:00100000:2.0:1784938344.099842:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144263040 00000100:00100000:2.0:1784938344.099863:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144261888 00000100:00100000:2.0:1784938344.099866:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144261888 00000100:00100000:2.0:1784938344.099879:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144262400 00000100:00100000:2.0:1784938344.099881:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144262400 00000100:00100000:2.0:1784938344.099894:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144262912 00000100:00100000:2.0:1784938344.099896:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144262912 00000100:00100000:2.0:1784938344.099908:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144262144 00000100:00100000:2.0:1784938344.099910:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144262144 00000100:00100000:2.0:1784938344.099933:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 382 00000100:00100000:2.0:1784938344.099944:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144262528:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.100012:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144262528:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 70us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938344.100020:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 382 00000100:00100000:2.0:1784938344.100039:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 383 00000100:00100000:2.0:1784938344.100045:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144263040:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.100068:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144263040:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938344.100074:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 383 00000100:00100000:2.0:1784938344.100084:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 384 00000100:00100000:2.0:1784938344.100089:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144261888:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.100113:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144261888:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938344.100119:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 384 00000100:00100000:2.0:1784938344.100130:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 385 00000100:00100000:2.0:1784938344.100135:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144262400:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.100173:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144262400:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938344.100179:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 385 00000100:00100000:2.0:1784938344.100191:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 386 00000100:00100000:2.0:1784938344.100196:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144262912:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.103681:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144262016 00000100:00100000:3.0:1784938344.103700:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144262016 00000100:00100000:3.0:1784938344.103769:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144262272 00000100:00100000:3.0:1784938344.103772:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144262272 00000100:00100000:3.0:1784938344.103793:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 221 00000100:00100000:3.0:1784938344.103803:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144262016:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.103887:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144262016:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 85us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938344.103895:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 221 00000100:00100000:3.0:1784938344.103916:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 222 00000100:00100000:3.0:1784938344.103923:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144262272:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.103949:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144262272:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (4627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938344.103955:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 222 00000100:00100000:3.0:1784938344.103979:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144262784 00000100:00100000:3.0:1784938344.103983:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144262784 00000100:00100000:3.0:1784938344.104015:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144262656 00000100:00100000:3.0:1784938344.104018:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144262656 00000100:00100000:3.0:1784938344.104041:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 155 00000100:00100000:3.0:1784938344.104046:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144262784:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.104074:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144262784:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (4711us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938344.104080:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 155 00000100:00100000:3.0:1784938344.104113:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 156 00000100:00100000:3.0:1784938344.104120:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144262656:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.104143:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144262656:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (4454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938344.104149:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 156 00000100:00100000:3.0:1784938344.104185:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 387 00000100:00100000:3.0:1784938344.104194:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144262144:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.104244:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144262144:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 52us (4861us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938344.104251:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 387 00000100:00100000:2.0:1784938344.104796:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1871643144262912:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 4593us (5482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938344.104806:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 386 00000100:00080000:2.0:1784938344.104835:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938344.104840:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938344.104845:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938344.105103:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144262144:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.105123:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144262272:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.105170:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144261888:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938344.105184:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1871643144262912:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938344.105200:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678c000 x1871643144262528/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938344.105230:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144262528:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938344.105710:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938344.105756:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144263168 00000100:00100000:0.0:1784938344.105763:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144263168 00000100:00100000:0.0:1784938344.105819:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 157 00000100:00100000:0.0:1784938344.105830:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144263168:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938344.105893:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144263168:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938344.105918:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 157 00000100:00100000:3.0:1784938344.106303:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144262656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.106319:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144263168:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.106351:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144262784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.106386:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144262400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938344.106399:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144262016:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938344.106412:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678ce00 x1871643144263040/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938344.106422:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144263040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938344.106546:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144261760 00000100:00100000:1.0:1784938344.106552:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144261760 00000100:00100000:1.0:1784938344.106592:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1784938344.106600:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144261760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938344.106659:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144261760:12345-0@lo:400:kworker.0 Request processed in 60us (8498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938344.106666:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1784938344.106714:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144261760:0@lo:400:kworker.0 00000100:00100000:2.0:1784938344.107647:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144263296 00000100:00100000:2.0:1784938344.107667:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144263296 00000100:00100000:2.0:1784938344.107735:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 165 00000100:00100000:2.0:1784938344.107745:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144263296:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938344.107790:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784938344.107856:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144263296:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 113us (8453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938344.107863:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 165 00000100:00080000:2.0:1784938344.107891:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938344.110059:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144263296:192.168.203.126@tcp:13:osp-pre-1-0.0 00010000:00010000:3.0:1784938345.055849:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938345.119653:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938345.121252:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144263424:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938345.122149:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938345.122188:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144263424 00000100:00100000:3.0:1784938345.122206:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144263424 00000100:00100000:3.0:1784938345.122308:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 166 00000100:00100000:3.0:1784938345.122326:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144263424:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938345.122365:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938345.122417:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144263424:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938345.122425:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 166 00000100:00100000:1.0:1784938345.122800:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144263424:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938345.125477:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144263552:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938345.127724:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938345.127773:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144263552 00000100:00100000:3.0:1784938345.127797:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144263552 00000100:00100000:3.0:1784938345.127859:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 167 00000100:00100000:3.0:1784938345.127871:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144263552:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938345.127906:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784938345.127975:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144263552:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 106us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938345.127984:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 167 00000100:00100000:1.0:1784938345.133204:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144263552:192.168.203.126@tcp:13:osp-pre-0-1.0 00000040:00080000:2.0:1784938345.187163:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1784938345.481707:0:14956:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:12:23 (1784938343) 00000040:00080000:1.0:1784938345.634414:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938345.634427:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938345.634559:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1784938345.634570:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1784938345.644581:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1784938345.644602:0:6492:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1784938345.644678:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1784938345.644692:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1784938346.079687:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938346.143815:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144263680:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938346.144202:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938346.144263:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144263680 00000100:00100000:2.0:1784938346.145509:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144263680 00000100:00100000:2.0:1784938346.145596:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 223 00000100:00100000:2.0:1784938346.145608:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144263680:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938346.145659:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1784938346.145738:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144263680:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 131us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938346.145746:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 223 00000100:00100000:0.0:1784938346.146172:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144263680:192.168.203.126@tcp:41:osp-pre-0-1.0 00000001:00080000:1.0:1784938346.148466:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:0.0:1784938347.103466:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938347.680697:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938347.682933:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144263808:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938347.684886:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938347.685008:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144263808 00000100:00100000:1.0:1784938347.685020:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144263808 00000100:00100000:1.0:1784938347.685102:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 224 00000100:00100000:1.0:1784938347.685113:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144263808:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938347.685162:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938347.685661:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144263808:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 549us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938347.685671:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 224 00000100:00100000:1.0:1784938347.687231:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144263808:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:3.0:1784938348.127580:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938349.128910:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938349.129189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125333504 00000100:00100000:1.0:1784938349.129204:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125333504 00000100:00100000:1.0:1784938349.129449:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:1.0:1784938349.129465:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+18:13183:x1871643125333504:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:1.0:1784938349.130120:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:13183:x1871643125333504:12345-192.168.203.26@tcp:35:umount.0 Request processed in 651us (1217us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1784938349.130156:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00080000:2.0:1784938349.132471:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938349.133394:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938349.133672:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125333760 00000100:00100000:0.0:1784938349.133685:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125333760 00000100:00100000:0.0:1784938349.133763:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:0.0:1784938349.133775:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+19:13183:x1871643125333760:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:0.0:1784938349.134468:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:13183:x1871643125333760:12345-192.168.203.26@tcp:35:umount.0 Request processed in 691us (1080us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1784938349.134480:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:3.0:1784938349.144488:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938349.148198:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125334016 00000100:00100000:1.0:1784938349.148237:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125334016 00000100:00100000:1.0:1784938349.148755:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:1.0:1784938349.148770:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d019eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+20:13183:x1871643125334016:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:1.0:1784938349.149097:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d019eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:13183:x1871643125334016:12345-192.168.203.26@tcp:35:umount.0 Request processed in 330us (4685us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1784938349.149106:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:3.0:1784938349.153179:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938349.153445:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125334272 00000100:00100000:0.0:1784938349.153458:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125334272 00000100:00100000:0.0:1784938349.153545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:0.0:1784938349.153558:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:13183:x1871643125334272:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:0.0:1784938349.153988:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:13183:x1871643125334272:12345-192.168.203.26@tcp:35:umount.0 Request processed in 431us (823us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1784938349.153997:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00010000:00010000:1.0:1784938349.155874:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938349.159087:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938349.159136:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938349.159258:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125334528 00000100:00100000:0.0:1784938349.159271:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125334528 00000100:00100000:0.0:1784938349.159361:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125334400 00000100:00100000:0.0:1784938349.159364:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125334400 00000100:00100000:0.0:1784938349.159429:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1784938349.159441:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+14:2395:x1871643125334528:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938349.159461:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938349.159486:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7469600/0x26783cd1c59ee266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28528 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938349.159518:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938349.159599:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+13:2395:x1871643125334528:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 161us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938349.159608:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1784938349.159628:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1784938349.159635:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+12:2395:x1871643125334400:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938349.159645:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938349.159654:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7469400/0x26783cd1c59ee323 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28567 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938349.159663:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938349.159681:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:2395:x1871643125334400:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 46us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938349.159687:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1784938349.163583:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938349.163885:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125334656 00000100:00100000:0.0:1784938349.163898:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125334656 00000100:00100000:0.0:1784938349.163983:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1784938349.163995:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:2394:x1871643125334656:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938349.164017:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938349.164045:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ee576 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28640 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938349.164078:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938349.164156:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2394:x1871643125334656:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 163us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938349.164165:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1784938349.168311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938349.168460:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125335040 00000100:00100000:3.0:1784938349.168475:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125335040 00000100:00100000:3.0:1784938349.168586:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:3.0:1784938349.168602:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+7:2391:x1871643125335040:12345-192.168.203.26@tcp:9:umount.0 00000020:00000080:3.0:1784938349.168651:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee8b7 00000020:00010000:3.0:1784938349.168663:0:8431:0:(genops.c:1942:obd_stale_export_put()) Put export ffff910cc871f000: total 0 00000100:00080000:3.0:1784938349.168692:0:8431:0:(import.c:65:import_set_state_nolock()) ffff910cc871a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938349.168764:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1784938349.168984:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2391:x1871643125335040:12345-192.168.203.26@tcp:9:umount.0 Request processed in 387us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938349.168994:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00000020:00010000:3.0:1784938349.169019:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff910cc871f000: total 0 00010000:00010000:3.0:1784938349.169044:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff910cc871f000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1784938349.169110:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59eec6f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2882a expref: 4 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938349.169156:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a8660a7/0x26783cd1c59ef33e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a0d expref: 3 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938349.169172:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff910cc871f000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1784938349.169186:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938349.169188:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938349.169190:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938349.170250:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938349.175103:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938349.175528:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125335168 00000100:00100000:3.0:1784938349.175544:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125335168 00000100:00100000:3.0:1784938349.175648:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:3.0:1784938349.175664:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2391:x1871643125335168:12345-192.168.203.26@tcp:9:umount.0 00000020:00000080:3.0:1784938349.175714:0:8430:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee641 00000100:00080000:3.0:1784938349.175728:0:8430:0:(import.c:65:import_set_state_nolock()) ffff910bc7111000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1784938349.175857:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1784938349.175992:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1784938349.176256:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+2:2391:x1871643125335168:12345-192.168.203.26@tcp:9:umount.0 Request processed in 595us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938349.176267:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:3.0:1784938349.179386:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938349.179849:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125335296 00000100:00100000:0.0:1784938349.179865:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125335296 00000100:00100000:0.0:1784938349.179976:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 388 00000100:00100000:0.0:1784938349.179990:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125335296:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938349.180103:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2393:x1871643125335296:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 116us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938349.180112:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 388 00000100:00080000:3.0:1784938349.182456:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938349.182930:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938349.182977:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938349.183070:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125335552 00000100:00100000:1.0:1784938349.183082:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125335552 00000100:00100000:1.0:1784938349.183158:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125335424 00000100:00100000:1.0:1784938349.183162:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125335424 00000100:00100000:1.0:1784938349.183190:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 389 00000100:00100000:1.0:1784938349.183201:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125335552:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.183351:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2393:x1871643125335552:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 151us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.183359:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 389 00000100:00100000:1.0:1784938349.183379:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 390 00000100:00100000:1.0:1784938349.183386:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2393:x1871643125335424:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.183421:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2393:x1871643125335424:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.183427:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 390 00000100:00080000:0.0:1784938349.185199:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938349.185247:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784938349.185410:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938349.192905:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938349.193014:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125336576 00000100:00100000:3.0:1784938349.193027:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125336576 00000100:00100000:3.0:1784938349.193104:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 258 00000100:00100000:3.0:1784938349.193116:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+22:2391:x1871643125336576:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:3.0:1784938349.193161:0:9526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee274 00000020:00010000:3.0:1784938349.193181:0:9526:0:(genops.c:1942:obd_stale_export_put()) Put export ffff910bc5b2e000: total 0 00000100:00080000:3.0:1784938349.193186:0:9526:0:(import.c:65:import_set_state_nolock()) ffff910bc5b2d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938349.193277:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1784938349.193490:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:263deb07-6496-49f7-9596-7a44f1bd8c2b+21:2391:x1871643125336576:12345-192.168.203.26@tcp:39:umount.0 Request processed in 375us (600us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1784938349.193498:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 258 00000020:00010000:2.0:1784938349.194259:0:7463:0:(genops.c:1928:obd_stale_export_get()) Get export ffff910bc5b2e000: total 0 00010000:00010000:2.0:1784938349.194343:0:7463:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff910bc5b2e000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784938349.194388:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910cfd58b700) 00010000:00010000:2.0:1784938349.194393:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938349.194404:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77000/0x26783cd1c59ee5a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2864e expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194438:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938349.194441:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938349.194445:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76000/0x26783cd1c59ef2ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289f8 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194460:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938349.194462:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784938349.194466:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0000/0x26783cd1c59ef329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a06 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194483:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:2.0:1784938349.194485:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938349.194490:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ee617 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2866a expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194734:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:2.0:1784938349.194737:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938349.194742:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1400/0x26783cd1c59eec30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28815 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194786:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938349.194788:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938349.194794:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59eefe1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28926 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194808:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19a00) 00010000:00010000:2.0:1784938349.194811:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938349.194815:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0200/0x26783cd1c59eecd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28846 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194829:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:2.0:1784938349.194831:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938349.194835:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc0e00/0x26783cd1c59ef21f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a289c0 expref: 13 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194853:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:2.0:1784938349.194855:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784938349.194859:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0400/0x26783cd1c59eec5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28823 expref: 12 pid: 13805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194872:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff910bc66c0200) 00010000:00010000:2.0:1784938349.194874:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938349.194878:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77600/0x26783cd1c59ee912 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28743 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194894:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc66c0100) 00010000:00010000:2.0:1784938349.194897:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938349.194908:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0400/0x26783cd1c59ee5bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28655 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194929:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff910bc1795000) 00010000:00010000:2.0:1784938349.194931:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938349.194935:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cffbc1c00/0x26783cd1c59eecf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2884d expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194952:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff910bc66c0e00) 00010000:00010000:2.0:1784938349.194955:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938349.194958:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59eeb50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a287dd expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938349.194971:0:7463:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff910bc5b2e000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1784938349.194992:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938349.194995:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938349.194997:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938349.206628:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938349.206794:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125336704 00000100:00100000:2.0:1784938349.206806:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125336704 00000100:00100000:2.0:1784938349.206882:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 259 00000100:00100000:2.0:1784938349.206893:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+5:2391:x1871643125336704:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:2.0:1784938349.206945:0:6512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee27b 00000100:00080000:2.0:1784938349.206968:0:6512:0:(import.c:65:import_set_state_nolock()) ffff910bc70fb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938349.207002:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1784938349.207528:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938349.211277:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:263deb07-6496-49f7-9596-7a44f1bd8c2b+3:2391:x1871643125336704:12345-192.168.203.26@tcp:39:umount.0 Request processed in 4375us (4652us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784938349.211301:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 259 00000100:00100000:2.0:1784938349.216442:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144263936:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938349.216824:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938349.216872:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144263936 00000100:00100000:0.0:1784938349.216881:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144263936 00000100:00100000:1.0:1784938349.216949:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144264064:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938349.216950:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 168 00000100:00100000:0.0:1784938349.216961:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144263936:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938349.216997:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1784938349.217396:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938349.217475:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144263936:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 461us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938349.217496:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 168 00000100:00100000:1.0:1784938349.217761:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144264320:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.217814:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144264832:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.217840:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144265344:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.217866:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784938349.217873:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144264192:0@lo:400:kworker.0 00000100:00100000:1.0:1784938349.217924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938349.217966:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144264704:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.217996:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144265216:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.218034:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144264192 00000100:00100000:1.0:1784938349.218041:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144264192 00000100:00100000:1.0:1784938349.218090:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1784938349.218100:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144264192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938349.218155:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144264192:12345-0@lo:400:kworker.0 Request processed in 56us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.218163:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1784938349.218243:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144264192:0@lo:400:kworker.0 00000100:00100000:1.0:1784938349.218272:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144264576:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.218313:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144265088:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.218334:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144265600:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.218356:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784938349.218361:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144264448:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.218397:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144264960:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.218431:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144265472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938349.219880:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.219946:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.219993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220055:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220119:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220145:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220165:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220186:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220212:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220259:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220281:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220697:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938349.220735:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144264064 00000100:00100000:3.0:1784938349.220767:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144264064 00000100:00100000:3.0:1784938349.220841:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 169 00000100:00100000:3.0:1784938349.220852:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144264064:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938349.220883:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1784938349.220946:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144264064:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 96us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938349.220954:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 169 00000100:00100000:3.0:1784938349.220981:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144264576 00000100:00100000:3.0:1784938349.220985:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144264576 00000100:00100000:3.0:1784938349.221007:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144264320 00000100:00100000:3.0:1784938349.221009:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144264320 00000100:00100000:3.0:1784938349.221020:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144264960 00000100:00100000:3.0:1784938349.221022:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144264960 00000100:00100000:3.0:1784938349.221035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144264832 00000100:00100000:3.0:1784938349.221038:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144264832 00000100:00100000:3.0:1784938349.221050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144265344 00000100:00100000:3.0:1784938349.221052:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144265344 00000100:00100000:3.0:1784938349.221065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144265472 00000100:00100000:3.0:1784938349.221067:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144265472 00000100:00100000:3.0:1784938349.221081:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 391 00000100:00100000:3.0:1784938349.221088:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144264576:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938349.221120:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144264576:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938349.221127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 391 00000100:00100000:3.0:1784938349.221140:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 392 00000100:00100000:3.0:1784938349.221146:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144264320:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938349.221168:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144264320:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938349.221185:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 392 00000100:00100000:3.0:1784938349.221198:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 393 00000100:00100000:3.0:1784938349.221204:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144264960:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938349.221269:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144264960:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 65us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938349.221276:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 393 00000100:00100000:1.0:1784938349.221425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144264704 00000100:00100000:1.0:1784938349.221430:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144264704 00000100:00100000:1.0:1784938349.221460:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144264448 00000100:00100000:1.0:1784938349.221463:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144264448 00000100:00100000:1.0:1784938349.221476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 225 00000100:00100000:1.0:1784938349.221482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144264704:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.221521:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144264704:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 39us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.221527:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 225 00000100:00100000:1.0:1784938349.221539:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 226 00000100:00100000:1.0:1784938349.221544:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144264448:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.221576:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144264448:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.221582:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 226 00000100:00100000:1.0:1784938349.221599:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144265088 00000100:00100000:1.0:1784938349.221602:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144265088 00000100:00100000:1.0:1784938349.221628:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144265216 00000100:00100000:1.0:1784938349.221631:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144265216 00000100:00100000:1.0:1784938349.221642:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144265600 00000100:00100000:1.0:1784938349.221644:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144265600 00000100:00100000:1.0:1784938349.221654:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 158 00000100:00100000:1.0:1784938349.221659:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144265088:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.221680:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144265088:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.221694:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 158 00000100:00100000:1.0:1784938349.221705:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 159 00000100:00100000:1.0:1784938349.221710:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144265216:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.221730:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144265216:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 20us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.221735:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 159 00000100:00100000:1.0:1784938349.221743:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 160 00000100:00100000:1.0:1784938349.221749:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144265600:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.221764:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144265600:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.221770:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 160 00000100:00100000:1.0:1784938349.221830:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144263936:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938349.222080:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 394 00000100:00100000:3.0:1784938349.222094:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144264832:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938349.222121:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1871643144264832:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 32us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938349.223881:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144264704:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938349.223899:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144265216:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938349.223912:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144264320:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938349.223924:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1871643144264832:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938349.223965:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144264448:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938349.223979:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678c700 x1871643144264960/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938349.223989:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144264960:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938349.223999:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144264576:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938349.224008:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144265088:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938349.224017:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1784938349.224021:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910bc7cc8a80, transno 4294967325 00000100:00100000:0.0:1784938349.224034:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144265600:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938349.224052:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144264064:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938349.226813:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 395 00000100:00100000:1.0:1784938349.226854:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144265344:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.226993:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144265344:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 161us (6804us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.227003:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 395 00000100:00100000:1.0:1784938349.227049:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 396 00000100:00100000:1.0:1784938349.227058:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144265472:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938349.227087:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144265472:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 31us (6392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938349.227093:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 396 00000100:00080000:1.0:1784938349.227202:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938349.227209:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938349.227212:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938349.227231:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938349.228838:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144265344:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938349.228904:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc678df80 x1871643144265472/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938349.228945:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144265472:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938349.229725:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 394 00010000:00010000:2.0:1784938350.175384:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938350.240022:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144265728:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938350.240148:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144265856:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938350.245344:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938350.245696:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144265728 00000100:00100000:2.0:1784938350.245711:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144265728 00000100:00100000:2.0:1784938350.245836:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 170 00000100:00100000:2.0:1784938350.245849:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144265728:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938350.245903:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938350.245991:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144265728:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 145us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938350.245999:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 170 00000100:00100000:0.0:1784938350.246534:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144265728:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938350.255047:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938350.255826:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144265856 00000100:00100000:1.0:1784938350.255843:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144265856 00000100:00100000:1.0:1784938350.255935:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 171 00000100:00100000:1.0:1784938350.255947:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144265856:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938350.255991:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784938350.256082:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144265856:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 137us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938350.256089:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 171 00000100:00100000:3.0:1784938350.262320:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144265856:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938351.125498:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938351.125563:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938351.128704:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125336832 00000100:00100000:1.0:1784938351.128720:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125336832 00000100:00100000:1.0:1784938351.128787:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125337088 00000100:00100000:1.0:1784938351.128791:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125337088 00000100:00100000:1.0:1784938351.129020:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1784938351.129031:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+11:2392:x1871643125336832:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938351.129047:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938351.129068:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7468e00/0x26783cd1c59ee377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2857c expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938351.129086:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938351.129159:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+10:2392:x1871643125336832:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 129us (3672us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938351.129176:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1784938351.129649:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1784938351.129659:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+9:2395:x1871643125337088:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938351.129669:0:7921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938351.129680:0:7921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9246200/0x26783cd1c59ee56f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28639 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938351.129703:0:7921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938351.129728:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:2395:x1871643125337088:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 71us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938351.129734:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:2.0:1784938351.147131:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938351.147304:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938351.147706:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125337344 00000100:00100000:0.0:1784938351.147717:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125337344 00000100:00100000:0.0:1784938351.147796:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 260 00000100:00100000:0.0:1784938351.147819:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+6:2391:x1871643125337344:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:0.0:1784938351.147858:0:6513:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee38c 00000020:00010000:0.0:1784938351.147866:0:6513:0:(genops.c:1942:obd_stale_export_put()) Put export ffff910bc7c67000: total 0 00000100:00080000:0.0:1784938351.147870:0:6513:0:(import.c:65:import_set_state_nolock()) ffff910bc7c65000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938351.147895:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1784938351.148071:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2391:x1871643125337344:12345-192.168.203.26@tcp:39:umount.0 Request processed in 266us (766us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1784938351.148079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 260 00000020:00010000:0.0:1784938351.148143:0:7463:0:(genops.c:1928:obd_stale_export_get()) Get export ffff910bc7c67000: total 0 00010000:00010000:0.0:1784938351.148148:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938351.148593:0:7463:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff910bc7c67000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784938351.148633:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19a00) 00010000:00010000:0.0:1784938351.148638:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938351.148646:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1c00/0x26783cd1c59ef34c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a14 expref: 4 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938351.148673:0:7463:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff910bc7c67000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1784938351.148686:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938351.148688:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938351.148703:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938351.149236:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125336960 00000100:00100000:3.0:1784938351.149623:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125336960 00000100:00100000:3.0:1784938351.149694:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1784938351.149706:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+8:2393:x1871643125336960:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938351.149720:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938351.149736:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9246e00/0x26783cd1c59ee37e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a285ad expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938351.149753:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938351.149824:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db2a3c47-6f11-4ea2-835e-381143ebe8d4+7:2393:x1871643125336960:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 120us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938351.149832:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00080000:2.0:1784938351.150941:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938351.163783:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938351.172729:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125337472 00000100:00100000:1.0:1784938351.172744:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125337472 00000100:00100000:0.0:1784938351.172953:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 261 00000100:00100000:0.0:1784938351.172967:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+5:2391:x1871643125337472:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:0.0:1784938351.173009:0:9526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee393 00000100:00080000:0.0:1784938351.173018:0:9526:0:(import.c:65:import_set_state_nolock()) ffff910bc7c64000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938351.173070:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:3.0:1784938351.173535:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784938351.173547:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938351.173638:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e0e55a1-2fc4-4192-a43b-67b180b29a8a+3:2391:x1871643125337472:12345-192.168.203.26@tcp:39:umount.0 Request processed in 673us (9862us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784938351.173647:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 261 00010000:00010000:2.0:1784938351.200829:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938351.206845:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938351.207629:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125337728 00000100:00100000:1.0:1784938351.207642:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125337728 00000100:00100000:1.0:1784938351.207713:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 405 00000100:00100000:1.0:1784938351.207722:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+7:2391:x1871643125337728:12345-192.168.203.26@tcp:251:umount.0 00000020:00000080:1.0:1784938351.207771:0:6507:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee251 00000020:00010000:1.0:1784938351.207781:0:6507:0:(genops.c:1942:obd_stale_export_put()) Put export ffff910bc5b2c800: total 0 00000100:00080000:1.0:1784938351.207787:0:6507:0:(import.c:65:import_set_state_nolock()) ffff910bc5b2f000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784938351.207932:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db2a3c47-6f11-4ea2-835e-381143ebe8d4+3:2391:x1871643125337728:12345-192.168.203.26@tcp:251:umount.0 Request processed in 209us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938351.207940:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 405 00000020:00010000:2.0:1784938351.208379:0:7463:0:(genops.c:1928:obd_stale_export_get()) Get export ffff910bc5b2c800: total 0 00010000:00010000:2.0:1784938351.208437:0:7463:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff910bc5b2c800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784938351.208473:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ee32a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a2856e expref: 2 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938351.208492:0:7463:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff910bc5b2c800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1784938351.208503:0:7463:0:(genops.c:906:class_export_put()) final put ffff910bc5b2c800/db2a3c47-6f11-4ea2-835e-381143ebe8d4 00010000:00010000:2.0:1784938351.208517:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938351.208520:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938351.208522:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784938351.210541:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc5b2c800/db2a3c47-6f11-4ea2-835e-381143ebe8d4 for MGS 00000020:00000080:1.0:1784938351.210596:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc5b2f000 for MGS 00000100:00100000:2.0:1784938351.263747:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144265984:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938351.264096:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938351.264181:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144265984 00000100:00100000:2.0:1784938351.264201:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144265984 00000100:00100000:2.0:1784938351.264296:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 227 00000100:00100000:2.0:1784938351.264306:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144265984:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938351.264343:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1784938351.264388:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144265984:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938351.264396:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 227 00000100:00100000:1.0:1784938351.264746:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144265984:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:0.0:1784938352.231580:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938352.799425:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144266112:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938352.799741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938352.799783:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144266112 00000100:00100000:1.0:1784938352.799790:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144266112 00000100:00100000:1.0:1784938352.799846:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 228 00000100:00100000:1.0:1784938352.799856:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144266112:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:1.0:1784938352.799895:0:7778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784938352.799941:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144266112:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938352.799950:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 228 00000100:00100000:1.0:1784938352.800094:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144266112:192.168.203.126@tcp:41:osp-pre-1-0.0 00000020:01000004:2.0:1784938352.960746:0:15152:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784938352.970560:0:15152:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1784938352.970636:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.970650:0:15152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.970659:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.970667:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.970697:0:15152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784938352.970703:0:15152:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784938352.970733:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938352.970737:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1784938352.970743:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1784938352.970744:0:15152:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1784938352.970751:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.970763:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938352.970767:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.970777:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784938352.970780:0:15152:0:(import.c:65:import_set_state_nolock()) ffff910cc4879000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:3.0:1784938352.970789:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938352.970797:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938352.970800:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784938352.970803:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784938352.970835:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.970843:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938352.970873:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.970891:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b76800/0x26783cd1c59ee2f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee300 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.970905:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938352.970907:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938352.970910:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938352.970919:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938352.970938:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144266368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938352.970966:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144266240:192.168.203.126@tcp:39:umount.0 00000100:00100000:3.0:1784938352.971021:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938352.971101:0:9518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144266368 00000100:00100000:3.0:1784938352.971107:0:9518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144266368 00000100:00100000:3.0:1784938352.971171:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784938352.971181:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3641:x1871643144266368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938352.971197:0:9518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938352.971240:0:9518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ee300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee2f9 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.971256:0:9518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938352.978036:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938352.978331:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144266240 00000100:00100000:2.0:1784938352.978342:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144266240 00000100:00100000:2.0:1784938352.978400:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 262 00000100:00100000:2.0:1784938352.978409:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871643144266240:12345-192.168.203.126@tcp:39:umount.0 00000020:00000080:2.0:1784938352.978441:0:6512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ede68 00000100:00080000:2.0:1784938352.978452:0:6512:0:(import.c:65:import_set_state_nolock()) ffff910cc4807000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784938352.978535:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1871643144266240:12345-192.168.203.126@tcp:39:umount.0 Request processed in 125us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938352.978544:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 262 00000020:00000080:2.0:1784938352.978558:0:6512:0:(genops.c:906:class_export_put()) final put ffff910cc4803800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1784938352.978582:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784938352.979349:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc4803800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938352.979401:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cc4807000 for lustre-MDT0000 00000100:00080000:2.0:1784938352.979832:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc4879000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784938352.979849:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144266240:192.168.203.126@tcp:39:umount.0 00000100:00080000:1.0:1784938352.980187:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938352.980192:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784938352.980197:0:15152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1784938352.981574:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144266368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938352.983344:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3641:x1871643144266368:12345-0@lo:103:ldlm_bl.0 Request processed in 12156us (12315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938352.983357:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1784938352.983404:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983417:0:15152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983425:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983433:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983452:0:15152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938352.983458:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983464:0:15152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983470:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983477:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983510:0:15152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938352.983518:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983525:0:15152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983531:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983538:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983551:0:15152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784938352.983558:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983565:0:15152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983572:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983579:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938352.983586:0:15152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1784938352.983589:0:15152:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1784938352.985571:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938352.985583:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985595:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc0030a00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938352.985599:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985621:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938352.985628:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938352.985633:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938352.985636:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1784938352.985638:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1784938352.985679:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985685:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938352.985710:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985717:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cc0030a00/0x26783cd1c59ee307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee30e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985730:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938352.985734:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985739:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938352.985742:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985749:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938352.985765:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938352.985770:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938352.985772:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784938352.985773:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784938352.985786:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985791:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938352.985804:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985810:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b77200/0x26783cd1c59ee20b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee212 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985820:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938352.985823:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985828:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0600 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938352.985831:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985837:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938352.985842:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938352.985856:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784938352.985858:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784938352.985861:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784938352.985873:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985879:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938352.985885:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985891:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cffbc0600/0x26783cd1c59ee561 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee568 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985899:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938352.985902:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985907:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247a00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938352.985909:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985915:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938352.985921:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938352.985926:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938352.985928:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784938352.985930:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784938352.985947:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985953:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938352.985959:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985964:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cd9247a00/0x26783cd1c59eddc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59eddce expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.985973:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938352.985975:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938352.985977:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938352.985995:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144266880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938352.986059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938352.986106:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938352.986113:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144266496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938352.986133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938352.986244:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144266624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938352.986278:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938352.986298:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938352.986303:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144266752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938352.986333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938352.986362:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144266880 00000100:00100000:3.0:1784938352.986368:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144266880 00000100:00100000:3.0:1784938352.986491:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144266496 00000020:01000004:1.0:1784938352.986494:0:15152:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000100:00100000:3.0:1784938352.986495:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144266496 00000020:01000000:1.0:1784938352.986501:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1784938352.986507:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000100:00100000:3.0:1784938352.986513:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144266624 00000020:00000080:1.0:1784938352.986513:0:15152:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000100:00100000:3.0:1784938352.986518:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144266624 00000020:00080000:1.0:1784938352.986523:0:15152:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff910bc7162800 lustre-MDT0000-lwp-OST0001_UUID 192.168.203.126@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:3.0:1784938352.986531:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144266752 00000020:00080000:1.0:1784938352.986532:0:15152:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff910bc58d1800 lustre-MDT0000-lwp-OST0000_UUID 192.168.203.126@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938352.986538:0:15152:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff910cfd139800 lustre-MDT0000-lwp-MDT0001_UUID 192.168.203.126@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:3.0:1784938352.986543:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144266752 00000020:00080000:1.0:1784938352.986546:0:15152:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff910cfcfc4000 lustre-MDT0001-mdtlov_UUID 192.168.203.126@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1784938352.986553:0:15152:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff910bc7c67000 2e0e55a1-2fc4-4192-a43b-67b180b29a8a 192.168.203.26@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938352.986559:0:15152:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff910bc5b2e000 263deb07-6496-49f7-9596-7a44f1bd8c2b 192.168.203.26@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1784938352.986565:0:15152:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff910cecfa3380) has exports, disconnecting them 00000100:00100000:3.0:1784938352.986569:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000020:00080000:1.0:1784938352.986573:0:15152:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.126@tcp (ffff910bc7162800), last request at 1784938349 00000100:00100000:3.0:1784938352.986581:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+26:3640:x1871643144266880:12345-0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1784938352.986583:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee178 00010000:00010000:3.0:1784938352.986598:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1784938352.986603:0:15152:0:(import.c:65:import_set_state_nolock()) ffff910bc7166000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784938352.986613:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc0031600/0x26783cd1c59eddce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59eddc7 expref: 26 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.986628:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:1.0:1784938352.986656:0:15152:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910bc7162800): rc 0 00000020:00000080:1.0:1784938352.986660:0:15152:0:(genops.c:906:class_export_put()) final put ffff910bc7162800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:3.0:1784938352.986668:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+25:3640:x1871643144266880:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (607us total) trans 0 rc 0/0 00000020:00080000:1.0:1784938352.986675:0:15152:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.126@tcp (ffff910bc58d1800), last request at 1784938349 00000100:00100000:3.0:1784938352.986679:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:1.0:1784938352.986681:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee052 00000100:00080000:1.0:1784938352.986690:0:15152:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784938352.986699:0:15152:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910bc58d1800): rc 0 00000020:00000080:1.0:1784938352.986702:0:15152:0:(genops.c:906:class_export_put()) final put ffff910bc58d1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1784938352.986706:0:15152:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.126@tcp (ffff910cfd139800), last request at 1784938095 00000020:00000080:1.0:1784938352.986709:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edf4f 00000100:00080000:1.0:1784938352.986712:0:15152:0:(import.c:65:import_set_state_nolock()) ffff910cfd13d800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784938352.986715:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000020:00080000:1.0:1784938352.986720:0:15152:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910cfd139800): rc 0 00000100:00100000:3.0:1784938352.986725:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+24:3640:x1871643144266496:12345-0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1784938352.986733:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cfd139800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:3.0:1784938352.986738:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1784938352.986741:0:15152:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.126@tcp (ffff910cfcfc4000), last request at 1784938095 00000020:00000080:1.0:1784938352.986747:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edf1e 00010000:00010000:3.0:1784938352.986751:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ee30e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee307 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784938352.986753:0:15152:0:(import.c:65:import_set_state_nolock()) ffff910cfcfc7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938352.986763:0:15152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:3.0:1784938352.986765:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938352.986789:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+23:3640:x1871643144266496:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938352.986796:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784938352.986809:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784938352.986816:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+22:3642:x1871643144266624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938352.986824:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938352.986833:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d0600/0x26783cd1c59ee212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee20b expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784938352.986843:0:15152:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910cfcfc4000): rc 0 00010000:00010000:3.0:1784938352.986844:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00000080:1.0:1784938352.986851:0:15152:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb7d541c97ae0 00000100:00080000:1.0:1784938352.986869:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784938352.986873:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1784938352.986885:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+21:3642:x1871643144266624:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938352.986892:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784938352.986905:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784938352.986912:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6a69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+20:3642:x1871643144266752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938352.986919:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938352.986930:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9247800/0x26783cd1c59ee568 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee561 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938352.986939:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938352.986959:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6a69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7782ae5c-cb83-4240-bccc-1dc097db054d+19:3642:x1871643144266752:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938352.986965:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784938352.987039:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144266496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938352.987048:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144266880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938352.987072:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144266752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938352.987079:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144266624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938352.987091:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938352.987589:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938352.987723:0:15152:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784938352.987742:0:15152:0:(import.c:65:import_set_state_nolock()) ffff910cfb28c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784938352.987813:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144267008:192.168.203.126@tcp:39:umount.0 00010000:00010000:0.0:1784938352.990008:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784938352.990044:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7162800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938352.990103:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc58d1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938352.990140:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfd139800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784938352.990175:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc7166000 for lustre-MDT0000 00000020:00000080:0.0:1784938352.990183:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc58d5800 for lustre-MDT0000 00000020:00000080:0.0:1784938352.990187:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cfd13d800 for lustre-MDT0000 00000100:00080000:3.0:1784938352.990696:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938352.990702:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1784938352.990723:0:15152:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784938352.990789:0:15152:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784938352.990814:0:15152:0:(import.c:65:import_set_state_nolock()) ffff910bc5b28000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784938352.990855:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938352.990858:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1784938352.990875:0:15152:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784938352.990937:0:15152:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784938352.990947:0:15152:0:(import.c:65:import_set_state_nolock()) ffff910bc73d5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784938352.990986:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff910cecfa3380) has no exports 00000100:00100000:0.0:1784938352.991551:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144267136:192.168.203.126@tcp:9:umount.0 00000100:00100000:0.0:1784938352.991633:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144267264:192.168.203.126@tcp:9:umount.0 00000100:00100000:2.0:1784938352.995050:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938352.995130:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938352.995172:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938352.995200:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144267136 00000100:00100000:2.0:1784938352.995209:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144267136 00000100:00100000:2.0:1784938352.995293:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144267264 00000100:00100000:2.0:1784938352.995297:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144267264 00000100:00100000:2.0:1784938352.995320:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00100000:2.0:1784938352.995328:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871643144267136:12345-192.168.203.126@tcp:9:umount.0 00000020:00000080:2.0:1784938352.995361:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee101 00000100:00080000:2.0:1784938352.995370:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910cc487a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938352.995413:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1784938352.995750:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3639:x1871643144267136:12345-192.168.203.126@tcp:9:umount.0 Request processed in 420us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938352.995759:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 82 00000100:00100000:2.0:1784938352.995777:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 83 00000100:00100000:2.0:1784938352.995784:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1871643144267264:12345-192.168.203.126@tcp:9:umount.0 00000020:00000080:2.0:1784938352.995796:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee23c 00000100:00080000:2.0:1784938352.995802:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910bc70fd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938352.995825:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1784938352.996171:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3639:x1871643144267264:12345-192.168.203.126@tcp:9:umount.0 Request processed in 108us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938352.996178:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 83 00000100:00100000:2.0:1784938352.996201:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144267008 00000100:00100000:2.0:1784938352.996205:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144267008 00000100:00100000:2.0:1784938352.996276:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 229 00000100:00100000:2.0:1784938352.996283:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1871643144267008:12345-192.168.203.126@tcp:39:umount.0 00000020:00000080:2.0:1784938352.996299:0:6518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edfaa 00000100:00080000:2.0:1784938352.996305:0:6518:0:(import.c:65:import_set_state_nolock()) ffff910cfd13b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938352.996335:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1784938352.996428:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3639:x1871643144267008:12345-192.168.203.126@tcp:39:umount.0 Request processed in 145us (1297us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784938352.996435:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 229 00000100:00080000:2.0:1784938352.996472:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938352.996476:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784938352.996873:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938352.996884:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938352.997004:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938352.997142:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc5b28000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784938352.997162:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784938352.997166:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784938352.997173:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144267136:192.168.203.126@tcp:9:umount.0 00000100:00080000:1.0:1784938352.997188:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc73d5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784938352.997227:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784938352.997229:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784938352.997233:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144267264:192.168.203.126@tcp:9:umount.0 00000100:00080000:1.0:1784938352.997249:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cfb28c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784938352.997254:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144267008:192.168.203.126@tcp:39:umount.0 00000020:00080000:3.0:1784938353.015346:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff910cecfa3380) has no exports 00000020:00000080:3.0:1784938353.110429:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ede22 00000020:00000080:3.0:1784938353.110444:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cfb289000/lustre-QMT0000_UUID 00000020:01000000:3.0:1784938353.110462:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784938353.110517:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938353.110541:0:15152:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938353.110545:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff910cc9434d40) has no exports 00000020:00000080:0.0:1784938353.111344:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfb289000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784938353.114015:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ede1b 00000020:00000080:2.0:1784938353.114029:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cfb28f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784938353.114105:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938353.114118:0:15152:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938353.114121:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cc4859000/lustre-QMT0000_UUID 00000020:00000080:2.0:1784938353.114125:0:15152:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc4859000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784938353.114137:0:15152:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938353.118307:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfb28f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1784938353.247383:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938354.274070:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938354.335447:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144267776:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938354.335582:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144268288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938354.335619:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784938354.335641:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144267392:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938354.335677:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144267904:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938354.335706:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144268416:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938354.335977:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144267520:0@lo:400:kworker.0 00000100:00100000:3.0:1784938354.336027:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938354.336055:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144268032:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938354.336330:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938354.336351:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938354.336370:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938354.336391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938354.336406:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938354.336439:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144267776 00000100:00100000:0.0:1784938354.336446:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144267776 00000100:00100000:0.0:1784938354.336477:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144268288 00000100:00100000:0.0:1784938354.336479:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144268288 00000100:00100000:0.0:1784938354.336486:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144267904 00000100:00100000:0.0:1784938354.336488:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144267904 00000100:00100000:0.0:1784938354.336495:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144268416 00000100:00100000:0.0:1784938354.336496:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144268416 00000100:00100000:0.0:1784938354.336523:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 397 00000100:00100000:0.0:1784938354.336531:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144268416:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938354.336572:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144268416:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 42us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938354.336579:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 397 00000100:00100000:0.0:1784938354.336593:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 263 00000100:00100000:0.0:1784938354.336597:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1871643144267776:12345-192.168.203.126@tcp:400:kworker.0 00000020:00080000:0.0:1784938354.336603:0:13805:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.126@tcp 00000100:00100000:0.0:1784938354.336620:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1871643144267776:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (291us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938354.336636:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 263 00000100:00100000:0.0:1784938354.336648:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 264 00000100:00100000:0.0:1784938354.336652:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1871643144268288:12345-192.168.203.126@tcp:400:kworker.0 00000020:00080000:0.0:1784938354.336657:0:13805:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.126@tcp 00000100:00100000:0.0:1784938354.336671:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1871643144268288:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 18us (319us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938354.336676:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 264 00000100:00100000:0.0:1784938354.336685:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 265 00000100:00100000:0.0:1784938354.336689:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1871643144267904:12345-192.168.203.126@tcp:400:kworker.0 00000020:00080000:0.0:1784938354.336693:0:13805:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.126@tcp 00000100:00100000:0.0:1784938354.336706:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1871643144267904:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (315us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938354.336712:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 265 00000100:00100000:0.0:1784938354.336730:0:14169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144267392 00000100:00100000:0.0:1784938354.336733:0:14169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144267392 00000100:00100000:0.0:1784938354.336755:0:14169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 172 00000100:00100000:0.0:1784938354.336760:0:14169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144267392:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:0.0:1784938354.336781:0:14169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784938354.336803:0:14169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144267392:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 42us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938354.336809:0:14169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 172 00000100:00080000:0.0:1784938354.337345:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938354.337351:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938354.337384:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144267520 00000100:00100000:0.0:1784938354.337389:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144267520 00000100:00100000:0.0:1784938354.338003:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1784938354.338015:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+19:3642:x1871643144267520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938354.338075:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cf3b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7782ae5c-cb83-4240-bccc-1dc097db054d+19:3642:x1871643144267520:12345-0@lo:400:kworker.0 Request processed in 65us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938354.338082:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1784938354.338154:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144267648:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938354.338198:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144268160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938354.342471:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938354.342852:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144268544:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938354.342952:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144267520:0@lo:400:kworker.0 00000100:00100000:2.0:1784938354.345686:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938354.345875:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938354.345901:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938354.345928:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144267648 00000100:00100000:2.0:1784938354.345936:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144267648 00000100:00100000:2.0:1784938354.345978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 230 00000100:00100000:2.0:1784938354.345986:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1871643144267648:12345-192.168.203.126@tcp:400:kworker.0 00000020:00080000:2.0:1784938354.345994:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.126@tcp 00000100:00100000:2.0:1784938354.346060:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1871643144267648:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 74us (186us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784938354.346067:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 230 00000100:00100000:2.0:1784938354.346093:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144268032 00000100:00100000:2.0:1784938354.346096:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144268032 00000100:00100000:2.0:1784938354.346133:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 398 00000100:00100000:2.0:1784938354.346139:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144268032:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938354.346168:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144268032:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938354.346173:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 398 00000100:00080000:2.0:1784938354.346191:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938354.346285:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144267392:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00080000:2.0:1784938354.346299:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@192.168.203.126@tcp abruptly disconnected: reconnecting 00000100:00080000:2.0:1784938354.346303:0:3640:0:(import.c:65:import_set_state_nolock()) ffff910bc1755800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784938354.346307:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 192.168.203.126@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1784938354.346607:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144268160 00000100:00100000:1.0:1784938354.346613:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144268160 00000100:00100000:1.0:1784938354.346656:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144268544 00000100:00100000:1.0:1784938354.346659:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144268544 00000100:00100000:1.0:1784938354.346678:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 161 00000100:00100000:1.0:1784938354.346686:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144268160:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938354.346727:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144268160:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 42us (4268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938354.346748:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 161 00000100:00100000:1.0:1784938354.346761:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 162 00000100:00100000:1.0:1784938354.346769:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144268544:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938354.346792:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144268544:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938354.346797:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 162 00000100:00080000:1.0:1784938354.346961:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938354.347270:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@192.168.203.126@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1784938354.347275:0:3643:0:(import.c:65:import_set_state_nolock()) ffff910cfcfc2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784938354.347278:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 192.168.203.126@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784938354.347284:0:3643:0:(import.c:65:import_set_state_nolock()) ffff910cfcfc2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938354.347288:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 192.168.203.126@tcp last attempt 163 00000100:00080000:1.0:1784938354.347296:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff910cfcfc2000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:1.0:1784938354.347324:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc678d500 x1871643144268672/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.203.126@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938354.347345:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144267648:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938354.347361:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144268160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938354.347392:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144268672:192.168.203.126@tcp:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1784938354.347583:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938354.348503:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144268672 00000100:00100000:3.0:1784938354.348512:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144268672 00000100:00100000:3.0:1784938354.348564:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 231 00000100:00100000:3.0:1784938354.348571:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1871643144268672:12345-192.168.203.126@tcp:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1784938354.348590:0:7778:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.126@tcp (stopping) 00010000:00080000:1.0:1784938354.348668:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2073100 x1871643144268032/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938354.348693:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144268032:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938354.348706:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144268544:192.168.203.126@tcp:400:kworker.0 00000100:00080000:2.0:1784938354.372463:0:3640:0:(import.c:65:import_set_state_nolock()) ffff910bc1755800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938354.372474:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.203.126@tcp last attempt 185 00000100:00080000:2.0:1784938354.372488:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff910bc1755800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938354.372529:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cd2070380 x1871643144268800/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938354.372560:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144267904:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938354.373047:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1871643144268800:192.168.203.126@tcp:38:ptlrpcd_00_00.0 00010000:00080000:2.0:1784938354.373186:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2071880 x1871643144268416/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938354.373243:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144268416:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938354.373359:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938354.373413:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144268800 00000100:00100000:1.0:1784938354.373419:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144268800 00000100:00100000:1.0:1784938354.373462:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 266 00000100:00100000:1.0:1784938354.373473:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1871643144268800:12345-192.168.203.126@tcp:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1784938354.373491:0:9526:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.126@tcp (stopping) 00000100:00100000:1.0:1784938354.373536:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1871643144268800:12345-192.168.203.126@tcp:38:ptlrpcd_00_00.0 Request processed in 64us (180us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784938354.373546:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 266 00000100:00080000:2.0:1784938354.373561:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@192.168.203.126@tcp abruptly disconnected: reconnecting 00000100:00080000:2.0:1784938354.373566:0:3640:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784938354.373570:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 192.168.203.126@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784938354.373575:0:3640:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938354.373710:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc1755800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938354.373717:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:1.0:1784938354.373722:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1871643144268800:192.168.203.126@tcp:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1784938354.377198:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.203.126@tcp last attempt 211 00000100:00080000:2.0:1784938354.377229:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff910bc58d5000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938354.377284:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cd2073100 x1871643144268928/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938354.377312:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144268288:192.168.203.126@tcp:400:kworker.0 00000100:00080000:2.0:1784938354.377346:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@192.168.203.126@tcp abruptly disconnected: reconnecting 00000100:00080000:2.0:1784938354.377350:0:3640:0:(import.c:65:import_set_state_nolock()) ffff910cfd13f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784938354.377354:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 192.168.203.126@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784938354.377359:0:3640:0:(import.c:65:import_set_state_nolock()) ffff910cfd13f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938354.377363:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 192.168.203.126@tcp last attempt 163 00000100:00080000:2.0:1784938354.377369:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff910cfd13f000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938354.377381:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cd2070000 x1871643144269056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938354.377392:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144267776:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938354.378104:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144268928:192.168.203.126@tcp:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1784938354.378194:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871643144269056:192.168.203.126@tcp:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784938354.378508:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938354.378562:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938354.378598:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144268928 00000100:00100000:2.0:1784938354.378606:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144268928 00000100:00100000:2.0:1784938354.378647:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144269056 00000100:00100000:2.0:1784938354.378650:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144269056 00000100:00100000:2.0:1784938354.378667:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 267 00000100:00100000:2.0:1784938354.378675:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1871643144268928:12345-192.168.203.126@tcp:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1784938354.378693:0:13805:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.126@tcp (stopping) 00000100:00100000:2.0:1784938354.378732:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1871643144268928:12345-192.168.203.126@tcp:38:ptlrpcd_00_00.0 Request processed in 56us (225us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938354.378739:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 267 00000100:00100000:2.0:1784938354.378758:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 268 00000100:00100000:2.0:1784938354.378775:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1871643144269056:12345-192.168.203.126@tcp:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1784938354.378784:0:13805:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.126@tcp (stopping) 00000100:00100000:2.0:1784938354.378815:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1871643144269056:12345-192.168.203.126@tcp:38:ptlrpcd_00_00.0 Request processed in 52us (253us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938354.379395:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 268 00000100:00080000:1.0:1784938354.379660:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938354.379668:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:1.0:1784938354.379673:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144268928:192.168.203.126@tcp:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1784938354.379682:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cfd13f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938354.379686:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:1.0:1784938354.379701:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871643144269056:192.168.203.126@tcp:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784938354.391630:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1871643144268672:12345-192.168.203.126@tcp:38:ptlrpcd_00_03.0 Request processed in 43049us (44039us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938354.391645:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 231 00000100:00080000:1.0:1784938354.392012:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cfcfc2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938354.392019:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:1.0:1784938354.392023:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144268672:192.168.203.126@tcp:38:ptlrpcd_00_03.0 00000001:00100000:0.0:1784938354.852202:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784938354.852261:0:6492:0:(genops.c:906:class_export_put()) final put ffff910cfcfc4000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1784938354.852281:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000001:00080000:0.0:1784938354.852290:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1784938354.852294:0:6492:0:(genops.c:906:class_export_put()) final put ffff910bc7c67000/2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000001:00100000:0.0:1784938354.852301:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000001:00080000:0.0:1784938354.852309:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1784938354.852317:0:6492:0:(genops.c:906:class_export_put()) final put ffff910bc5b2e000/263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:3.0:1784938354.852461:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfcfc4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1784938354.852516:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7c67000/2e0e55a1-2fc4-4192-a43b-67b180b29a8a for lustre-MDT0000 00000020:00000080:3.0:1784938354.852543:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc5b2e000/263deb07-6496-49f7-9596-7a44f1bd8c2b for lustre-MDT0000 00000020:00000080:3.0:1784938354.852587:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cfcfc7000 for lustre-MDT0000 00000020:00000080:3.0:1784938354.852593:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc7c65000 for lustre-MDT0000 00000020:00000080:3.0:1784938354.852596:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc5b2d800 for lustre-MDT0000 00000001:00100000:2.0:1784938354.863083:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938354.863093:0:8424:0:(genops.c:906:class_export_put()) final put ffff910cc4819800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1784938354.863111:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:2.0:1784938354.863114:0:8424:0:(genops.c:906:class_export_put()) final put ffff910bc7114000/263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:1.0:1784938354.863117:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc4819800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784938354.863160:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7114000/263deb07-6496-49f7-9596-7a44f1bd8c2b for lustre-OST0000 00000020:00000080:1.0:1784938354.863189:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cc487a000 for lustre-OST0000 00000020:00000080:1.0:1784938354.863194:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc7111000 for lustre-OST0000 00000001:00100000:1.0:1784938354.863488:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784938354.863497:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1784938354.863500:0:7443:0:(genops.c:906:class_export_put()) final put ffff910cd200b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784938354.863518:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000001:00080000:1.0:1784938354.863523:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1784938354.863525:0:7443:0:(genops.c:906:class_export_put()) final put ffff910bc7c62000/2e0e55a1-2fc4-4192-a43b-67b180b29a8a 00000001:00100000:1.0:1784938354.863529:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000001:00080000:1.0:1784938354.863532:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1784938354.863534:0:7443:0:(genops.c:906:class_export_put()) final put ffff910bc70fd000/263deb07-6496-49f7-9596-7a44f1bd8c2b 00000001:00100000:3.0:1784938354.863608:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938354.863612:0:9509:0:(genops.c:906:class_export_put()) final put ffff910bc70ff000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784938354.863619:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:3.0:1784938354.863621:0:9509:0:(genops.c:906:class_export_put()) final put ffff910cc871f000/263deb07-6496-49f7-9596-7a44f1bd8c2b 00000020:00000080:2.0:1784938354.863667:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cd200b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1784938354.864209:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7c62000/2e0e55a1-2fc4-4192-a43b-67b180b29a8a for lustre-MDT0001 00000020:00000080:2.0:1784938354.864280:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc70fd000/263deb07-6496-49f7-9596-7a44f1bd8c2b for lustre-MDT0001 00000020:00000080:2.0:1784938354.864300:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc70ff000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784938354.864315:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc871f000/263deb07-6496-49f7-9596-7a44f1bd8c2b for lustre-OST0001 00000020:00000080:2.0:1784938354.864666:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cfd13b800 for lustre-MDT0001 00000020:00000080:2.0:1784938354.864672:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc7c64000 for lustre-MDT0001 00000020:00000080:2.0:1784938354.864675:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc70fb800 for lustre-MDT0001 00000020:00000080:2.0:1784938354.864679:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc70fd800 for lustre-OST0001 00000020:00000080:2.0:1784938354.864683:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cc871a800 for lustre-OST0001 00000020:01000000:2.0:1784938355.167624:0:15152:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910bc7648ea0 - data ffff910ce6f0e948/ffff910cffb86c00 00000020:01000000:2.0:1784938355.167820:0:15152:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910cef383240 - data ffff910ce6ca4288/ffff910cfb284000 00000001:00000004:2.0:1784938355.177532:0:15152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1784938355.234838:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784938355.234849:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1784938355.234868:0:15152:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff910bc678f480 x1871643144267008/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 224/224 e 0 to 0 dl 1784938362 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938355.234890:0:15152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784938355.236743:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938355.236751:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1784938355.236776:0:15152:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938355.236778:0:15152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784938355.237066:0:8764:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784938355.237071:0:8764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1784938355.237083:0:8764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1784938355.240125:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938355.240133:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1784938355.240154:0:15152:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938355.240156:0:15152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784938355.241005:0:9813:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784938355.241010:0:9813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1784938355.241021:0:9813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1784938355.244600:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59eddea 00000020:00000080:1.0:1784938355.244612:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cc4804800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938355.244785:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc4804800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938355.249121:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59eddff 00000020:00000080:1.0:1784938355.249136:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cc48c1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784938355.249178:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784938355.249184:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938355.249193:0:15152:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784938355.249197:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff910cecfa19c0) has no exports 00000004:01000000:1.0:1784938355.249423:0:15152:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784938355.249432:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee235 00000020:00000080:1.0:1784938355.249436:0:15152:0:(genops.c:906:class_export_put()) final put ffff910bc70fa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938355.251845:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc48c1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1784938355.251961:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784938355.251973:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938355.251988:0:15152:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784938355.251993:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff910cfd763380) has no exports 00000020:00000080:1.0:1784938355.252001:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee22e 00000020:00000080:1.0:1784938355.252009:0:15152:0:(genops.c:906:class_export_put()) final put ffff910bc73d1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938355.252030:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc70fa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784938355.253013:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc73d1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784938355.253106:0:15152:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784938355.253111:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784938355.253115:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1784938355.253121:0:15152:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784938355.253123:0:15152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784938355.253197:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938355.253210:0:15152:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938355.253244:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee0f3 00000020:00000080:1.0:1784938355.253263:0:15152:0:(genops.c:906:class_export_put()) final put ffff910bc5b29800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938355.253577:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc73d5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784938355.253583:0:38:0:(genops.c:906:class_export_put()) final put ffff910bc73d6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938355.253585:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc73d6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1784938355.253591:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784938355.253736:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784938355.253741:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938355.253749:0:15152:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784938355.253753:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff910cfd2019c0) has no exports 00000020:00000080:1.0:1784938355.253759:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee0ec 00000020:00000080:1.0:1784938355.253762:0:15152:0:(genops.c:906:class_export_put()) final put ffff910bc5b2b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938355.253781:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc5b29800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1784938355.254358:0:15152:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784938355.254362:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784938355.254366:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1784938355.254371:0:15152:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784938355.254373:0:15152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938355.254427:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc5b2b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938355.254687:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938355.254697:0:15152:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1784938355.254712:0:15152:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784938355.254727:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edfa3 00000020:00000080:1.0:1784938355.254732:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cfd210000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938355.254749:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc5b28000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784938355.254755:0:38:0:(genops.c:906:class_export_put()) final put ffff910bc5b28800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938355.254757:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc5b28800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1784938355.254761:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784938355.254865:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1784938355.254870:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938355.254876:0:15152:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784938355.254879:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff910cf7b0b380) has no exports 00000020:00000080:1.0:1784938355.254884:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edf9c 00000020:00000080:1.0:1784938355.254888:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cfd216000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784938355.254905:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfd210000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784938355.256002:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfd216000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784938355.256277:0:15152:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1784938355.256281:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784938355.256285:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1784938355.256291:0:15152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784938355.256334:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938355.256345:0:15152:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938355.256372:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938355.256375:0:15152:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938355.256390:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cc4801800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938355.256392:0:15152:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc4801800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784938355.256396:0:15152:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938355.256512:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ede06 00000020:00000080:0.0:1784938355.256518:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cc48c4800/lustre-MDD0000_UUID 00000020:01000000:0.0:1784938355.256522:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1784938355.256526:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938355.256530:0:15152:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938355.256534:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff910cecfa0000) has no exports 00000020:00000080:0.0:1784938355.256549:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938355.256552:0:15152:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1784938355.256556:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ede0d 00000020:00000080:0.0:1784938355.256559:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cc48c2000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784938355.256567:0:15152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cca3c9000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1784938355.256570:0:15152:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cca3c9000 3 00000020:01000004:0.0:1784938355.256573:0:15152:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff910cca3c9000 from lustre-MDT0000 00000020:00000080:0.0:1784938355.256588:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938355.256591:0:15152:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1784938355.256593:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cc4802000/lustre-MDT0000_UUID 00000020:00000080:0.0:1784938355.256595:0:15152:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc4802000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1784938355.256602:0:15152:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1784938355.256632:0:15152:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1784938355.256636:0:15152:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1784938355.256639:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1784938355.256641:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938355.256643:0:15152:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784938355.256649:0:15152:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff910cf3b05000 7782ae5c-cb83-4240-bccc-1dc097db054d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938355.256654:0:15152:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff910cc9433380) has exports, disconnecting them 00000020:00080000:0.0:1784938355.256658:0:15152:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff910cf3b05000), last request at 1784938072 00000020:00000080:0.0:1784938355.256672:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59eddab 00000020:00010000:0.0:1784938355.256676:0:15152:0:(genops.c:1942:obd_stale_export_put()) Put export ffff910cf3b05000: total 2 00000100:00080000:0.0:1784938355.256685:0:15152:0:(import.c:65:import_set_state_nolock()) ffff910cf3b00800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784938355.256703:0:15152:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff910cf3b05000): rc 0 00000020:00080000:0.0:1784938355.256707:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff910cc9433380) has no exports 00000100:00100000:0.0:1784938355.256771:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff910cef32c600:6505] 0 exiting: rc = 1 00000100:00100000:0.0:1784938355.256867:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff910cef34a000:6506] 1 exiting: rc = 0 00000100:00100000:0.0:1784938355.256922:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff910cef32d000:6507] 2 exiting: rc = 0 00000100:00100000:0.0:1784938355.256976:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.256984:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.256989:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.256995:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.256999:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257005:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257010:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257015:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257021:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257027:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257032:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257037:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257042:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257048:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257053:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257059:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257065:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257070:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257076:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257081:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257086:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257091:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257096:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257101:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257106:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257111:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257117:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257122:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257135:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257141:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257148:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257153:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257158:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257163:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257169:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257174:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257179:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257185:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257191:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257197:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257202:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257209:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257238:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257244:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257261:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257268:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257273:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257279:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257285:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257290:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257296:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257302:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257308:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257314:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257319:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257324:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257329:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257334:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257339:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257345:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257350:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257356:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257363:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938355.257377:0:15152:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1784938355.257850:0:6501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff910cf3b05000: total 2 00010000:00010000:0.0:1784938355.257891:0:6501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff910cf3b05000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784938355.257920:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7468600/0x26783cd1c59ee2f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee2eb expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.257937:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cd9246000/0x26783cd1c59edea7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59edea0 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.257952:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7468a00/0x26783cd1c59ee2e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee2dd expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.257965:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ee54c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee545 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.257974:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0c00/0x26783cd1c59ee55a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee553 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.257985:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc0030400/0x26783cd1c59edeb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59edeae expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.257997:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ee53e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee537 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.258009:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910bc7468800/0x26783cd1c59ee31c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee315 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.258019:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1e00/0x26783cd1c59ee2ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee2a5 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.258028:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc0030600/0x26783cd1c59ee2ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee2b3 expref: 5 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.258054:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1400/0x26783cd1c59ee1cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee1c5 expref: 4 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.258066:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc0031e00/0x26783cd1c59ee2c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee2c1 expref: 3 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.258077:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc0030200/0x26783cd1c59ee2d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x26783cd1c59ee2cf expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938355.258088:0:6501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff910cf3b05000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1784938355.258103:0:6501:0:(genops.c:906:class_export_put()) final put ffff910cf3b05000/7782ae5c-cb83-4240-bccc-1dc097db054d 00010000:00010000:0.0:1784938355.258111:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938355.258114:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938355.258115:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938355.258731:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cfb28c000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784938355.258740:0:38:0:(genops.c:906:class_export_put()) final put ffff910cfd217800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784938355.258742:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfd217800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1784938355.258749:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784938355.258811:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc48c4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784938355.258815:0:38:0:(genops.c:906:class_export_put()) final put ffff910d01870000/lustre-MDD0000_UUID 00000020:00000080:3.0:1784938355.258817:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910d01870000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784938355.258820:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784938355.258843:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc48c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784938355.258847:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf3b05000/7782ae5c-cb83-4240-bccc-1dc097db054d for MGS 00000020:00000080:3.0:1784938355.258874:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cf3b00800 for MGS 00000020:01000000:0.0:1784938355.259666:0:15152:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910bc76487e0 - data ffff910ce6f0e438/ffff910cffb84000 00000020:01000000:0.0:1784938355.259782:0:15152:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910cc40ad1e0 - data ffff910ce6c1c6c0/ffff910ce6b10c00 00000020:00000080:0.0:1784938355.260278:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edd8f 00000020:00000080:0.0:1784938355.260286:0:15152:0:(genops.c:906:class_export_put()) final put ffff910d01839800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784938355.260302:0:15152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cca3c9000 from MGS, refs=2 00000020:01000004:0.0:1784938355.260306:0:15152:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cca3c9000 2 00000020:01000004:0.0:1784938355.260310:0:15152:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff910cca3c9000 from MGS 00000020:00000080:0.0:1784938355.260336:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938355.260343:0:15152:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1784938355.260346:0:15152:0:(genops.c:906:class_export_put()) final put ffff910d01838000/MGS 00000020:00000080:0.0:1784938355.260348:0:15152:0:(genops.c:865:class_export_destroy()) destroying export ffff910d01838000/MGS for MGS 00000020:01000000:0.0:1784938355.260357:0:15152:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784938355.260662:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784938355.260666:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938355.260671:0:15152:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784938355.260680:0:15152:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff910cc487b000 lustre-MDT0000-lwp-MDT0000 192.168.203.126@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938355.260694:0:15152:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff910cf3bfcd40) has exports, disconnecting them 00000020:00080000:0.0:1784938355.260698:0:15152:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 192.168.203.126@tcp (ffff910cc487b000), last request at 1784938073 00000020:00000080:0.0:1784938355.260702:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ede5a 00000020:00080000:0.0:1784938355.260712:0:15152:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910cc487b000): rc 0 00000020:00000080:0.0:1784938355.260716:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cc487b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784938355.260865:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910d01839800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784938355.260873:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc487b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784938355.277293:0:15152:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784938355.277303:0:15152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938355.277308:0:15152:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784938355.277316:0:15152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938355.277350:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cc4879000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784938355.277510:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938355.277530:0:15152:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1784938355.277536:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cc487d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784938355.277540:0:15152:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc487d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784938355.277552:0:15152:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784938355.277635:0:15152:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cca3c9000 1 00000020:00000080:3.0:1784938355.277642:0:15152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edd81 00000020:00000080:3.0:1784938355.277648:0:15152:0:(genops.c:906:class_export_put()) final put ffff910d0183e000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1784938355.277657:0:15152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784938355.277665:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910d0183e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784938355.277674:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938355.277679:0:15152:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784938355.277683:0:15152:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff910cecfa4d40) has no exports 00010000:00010000:2.0:1784938355.356686:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938355.363549:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144269184:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:2.0:1784938355.363831:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938355.363874:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144269184 00000100:00100000:2.0:1784938355.363882:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144269184 00000100:00100000:2.0:1784938355.363933:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 173 00000100:00100000:2.0:1784938355.363941:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144269184:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938355.363970:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784938355.364009:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144269184:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938355.364015:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 173 00000100:00100000:2.0:1784938355.364137:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144269184:192.168.203.126@tcp:13:osp-pre-0-1.0 00000020:00000080:1.0:1784938355.367595:0:15152:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938355.367607:0:15152:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784938355.367612:0:15152:0:(genops.c:906:class_export_put()) final put ffff910cca3cc000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784938355.367616:0:15152:0:(genops.c:865:class_export_destroy()) destroying export ffff910cca3cc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784938355.367621:0:15152:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784938355.367727:0:15152:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff910cca3ce800 00000020:02000400:1.0:1784938355.367791:0:15152:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000040:00080000:0.0:1784938355.428963:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784938356.383488:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938357.407987:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938358.437183:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938358.785528:0:15353:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784938358.804789:0:15353:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1784938358.804887:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.804908:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.804917:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.804925:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.805111:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784938358.805120:0:15353:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784938358.805159:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938358.805165:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784938358.805193:0:15353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784938358.805200:0:15353:0:(import.c:65:import_set_state_nolock()) ffff910cfd13f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1784938358.805206:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938358.805208:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00010000:00010000:2.0:1784938358.805332:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938358.805342:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938358.805351:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1c00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938358.805363:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938358.805374:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938358.805382:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938358.805389:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938358.805391:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784938358.805394:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1784938358.805456:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784938358.805550:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938358.805558:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784938358.805643:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144269312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938358.805740:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938358.805876:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938358.805885:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1c00/0x26783cd1c59ee2dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee2e4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938358.805910:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938358.805912:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938358.805914:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938358.806008:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144269312 00000100:00100000:1.0:1784938358.806019:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144269312 00000100:00100000:1.0:1784938358.806119:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784938358.806130:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1871643144269312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1784938358.806137:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938358 with bad export cookie 2772032442307894699 00010000:00010000:3.0:1784938358.809250:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809275:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809284:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809291:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938358.809382:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938358.809389:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938358.809392:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809400:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938358.809403:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1000 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938358.809409:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809412:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809430:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938358.809432:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809443:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938358.809447:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938358.809468:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938358.809475:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1784938358.809493:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938358.809504:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938358.809509:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809516:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76a00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938358.809519:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938358.809524:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809527:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938358.809533:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1784938358.809542:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938358.809549:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938358.809552:0:7463:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784938358.809555:0:7463:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784938358.809569:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809577:0:7463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938358.809578:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1000/0x26783cd1c59ee2eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee2f2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809593:0:7463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938358.809612:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938358.809616:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938358.809618:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938358.809619:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938358.809638:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b76a00/0x26783cd1c59ee1c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee1cc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938358.809642:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144269440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938358.809656:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938358.809664:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938358.809666:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938358.809681:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809689:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809696:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809703:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809717:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938358.809725:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809731:0:15353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938358.809739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784938358.809745:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809753:0:15353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809771:0:15353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1784938358.809774:0:15353:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1784938358.809778:0:15353:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1784938358.809813:0:15353:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1784938358.809824:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1784938358.809829:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938358.809836:0:15353:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1784938358.809846:0:15353:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff910bc7166800 lustre-MDT0001-lwp-OST0001_UUID 192.168.203.126@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938358.809852:0:15353:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff910bc5b2b000 lustre-MDT0001-lwp-OST0000_UUID 192.168.203.126@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938358.809857:0:15353:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff910cf7b0cd40) has exports, disconnecting them 00000020:00080000:3.0:1784938358.809862:0:15353:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.203.126@tcp (ffff910bc7166800), last request at 1784938354 00000020:00000080:3.0:1784938358.809871:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee18d 00000100:00080000:3.0:1784938358.809889:0:15353:0:(import.c:65:import_set_state_nolock()) ffff910bc7160000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784938358.809930:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938358.809935:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809941:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cd9247200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938358.809945:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809953:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938358.809960:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938358.809966:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784938358.809968:0:7463:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784938358.809970:0:7463:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784938358.809989:0:7463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.809995:0:7463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938358.810009:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.810015:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cd9247200/0x26783cd1c59ee553 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59ee55a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.810026:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938358.810028:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.810034:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc0031a00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938358.810037:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.810043:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938358.810050:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938358.810056:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938358.810058:0:7463:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784938358.810060:0:7463:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784938358.810072:0:7463:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.810077:0:7463:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938358.810084:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.810090:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cc0031a00/0x26783cd1c59edeae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x26783cd1c59edeb5 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938358.810113:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938358.810115:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938358.810116:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784938358.810133:0:15353:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910bc7166800): rc 0 00000020:00000080:3.0:1784938358.810136:0:15353:0:(genops.c:906:class_export_put()) final put ffff910bc7166800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1784938358.810151:0:15353:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.203.126@tcp (ffff910bc5b2b000), last request at 1784938354 00000020:00000080:3.0:1784938358.810155:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee067 00000100:00080000:3.0:1784938358.810162:0:15353:0:(import.c:65:import_set_state_nolock()) ffff910bc5b29000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784938358.810172:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784938358.810180:0:15353:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910bc5b2b000): rc 0 00000020:00000080:3.0:1784938358.810182:0:15353:0:(genops.c:906:class_export_put()) final put ffff910bc5b2b000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1784938358.810190:0:15353:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb7d540c87ae0 00000100:00080000:3.0:1784938358.810259:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938358.810263:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1784938358.811034:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938358.811050:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144269824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938358.811109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784938358.811113:0:15353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784938358.811120:0:15353:0:(import.c:65:import_set_state_nolock()) ffff910cfcfc2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1784938358.811166:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144269440 00000100:00100000:0.0:1784938358.811176:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144269440 00000100:00100000:0.0:1784938358.812530:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144269824 00000100:00100000:0.0:1784938358.812544:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144269824 00000100:00100000:0.0:1784938358.812585:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938358.812594:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1871643144269440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784938358.812602:0:7921:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938358 with bad export cookie 2772032442307894699 00000100:00100000:2.0:1784938358.812697:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144269568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938358.812763:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938358.812788:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938358.812794:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144269696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938358.812817:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938358.812845:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1871643144269440:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (3110us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938358.812852:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1784938358.812859:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938358.812870:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144269568 00000100:00100000:0.0:1784938358.812873:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144269568 00000020:00000080:2.0:1784938358.812875:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7166800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:0.0:1784938358.812883:0:7921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144269696 00000100:00100000:0.0:1784938358.812885:0:7921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144269696 00000100:00100000:0.0:1784938358.812894:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938358.812898:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1871643144269824:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784938358.812909:0:7921:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938358 with bad export cookie 2772032442307894699 00000020:00000080:2.0:1784938358.812940:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc5b2b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1784938358.812972:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc7160000 for lustre-MDT0001 00000020:00000080:2.0:1784938358.812978:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc5b29000 for lustre-MDT0001 00000100:00100000:0.0:1784938358.813016:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1871643144269824:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (1906us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784938358.813024:0:9518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784938358.813033:0:9518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3642:x1871643144269568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784938358.813039:0:9518:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938358 with bad export cookie 2772032442307894699 00000100:00100000:0.0:1784938358.813040:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938358.813061:0:7921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784938358.813067:0:7921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1871643144269696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784938358.813072:0:7921:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938358 with bad export cookie 2772032442307894699 00000100:00100000:3.0:1784938358.813181:0:9518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3642:x1871643144269568:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (416us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938358.813183:0:7921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1871643144269696:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (363us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784938358.813194:0:9518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938358.813201:0:7921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1784938358.813274:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938358.813395:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784938358.813400:0:3641:0:(import.c:65:import_set_state_nolock()) ffff910cecfca800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784938358.813404:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1784938358.813538:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784938358.813544:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1784938358.813559:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784938358.813626:0:15353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784938358.813655:0:15353:0:(import.c:65:import_set_state_nolock()) ffff910bc6755000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784938358.813743:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784938358.813747:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:3.0:1784938358.813758:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784938358.813820:0:15353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784938358.813831:0:15353:0:(import.c:65:import_set_state_nolock()) ffff910bc7c63800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784938358.813857:0:15353:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff910cf7b0cd40) has no exports 00000100:00080000:3.0:1784938358.814418:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1784938358.819612:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144269952:192.168.203.126@tcp:9:umount.0 00000100:00100000:1.0:1784938358.819891:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144270080:192.168.203.126@tcp:9:umount.0 00000100:00100000:1.0:1784938358.820345:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938358.820439:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938358.821055:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144269952 00000100:00100000:1.0:1784938358.821066:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144269952 00000100:00100000:1.0:1784938358.821133:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144270080 00000100:00100000:1.0:1784938358.821136:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144270080 00000100:00100000:1.0:1784938358.821166:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:1.0:1784938358.821179:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871643144269952:12345-192.168.203.126@tcp:9:umount.0 00000020:00000080:1.0:1784938358.821941:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee0c2 00000100:00080000:1.0:1784938358.821958:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910bc6752000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938358.822017:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1784938358.822251:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3639:x1871643144269952:12345-192.168.203.126@tcp:9:umount.0 Request processed in 1071us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938358.822261:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 84 00000100:00100000:1.0:1784938358.822283:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00100000:1.0:1784938358.822293:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1871643144270080:12345-192.168.203.126@tcp:9:umount.0 00000020:00000080:1.0:1784938358.822309:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee1fd 00000100:00080000:1.0:1784938358.822316:0:8429:0:(import.c:65:import_set_state_nolock()) ffff910bc67e2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938358.822339:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1784938358.822430:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3639:x1871643144270080:12345-192.168.203.126@tcp:9:umount.0 Request processed in 138us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938358.822437:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 85 00000100:00080000:1.0:1784938358.822623:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938358.822629:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784938358.822647:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938358.822653:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938358.823006:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc6755000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784938358.823024:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784938358.823027:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784938358.823033:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144269952:192.168.203.126@tcp:9:umount.0 00000100:00080000:1.0:1784938358.823051:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc7c63800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784938358.823061:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784938358.823063:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784938358.823066:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144270080:192.168.203.126@tcp:9:umount.0 00000100:00100000:1.0:1784938358.823173:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1871643144269312:12345-0@lo:103:ldlm_bl.0 Request processed in 17043us (17432us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784938358.823198:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1784938358.824332:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784938358.840390:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.126@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784938358.840397:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784938358.840408:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cd2071180 x1871643144269312/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938374 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938358.840422:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffbfd880 x1871643144269440/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938374 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938358.840432:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffb25880 x1871643144269824/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938374 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938358.840440:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffb24700 x1871643144269568/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938374 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938358.840450:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffb26680 x1871643144269696/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938374 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784938358.840812:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784938358.840816:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784938358.840817:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784938358.841963:0:3642:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff910cecfca800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1784938358.841963:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff910cecfca800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1784938358.842005:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7782ae5c-cb83-4240-bccc-1dc097db054d:3640:1871643144269312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938358.842022:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144269568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938358.842058:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7782ae5c-cb83-4240-bccc-1dc097db054d:3642:1871643144269696:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1784938358.844121:0:3641:0:(import.c:65:import_set_state_nolock()) ffff910cecfca800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938358.844136:0:3641:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 140 00000100:00080000:0.0:1784938358.844147:0:3641:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff910cecfca800 using connection 7782ae5c-cb83-4240-bccc-1dc097db054d/0@lo 00000100:00100000:0.0:1784938358.844188:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfc700 x1871643144270208/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938358.844348:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144269440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938358.844373:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7782ae5c-cb83-4240-bccc-1dc097db054d:3641:1871643144269824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938358.844584:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7782ae5c-cb83-4240-bccc-1dc097db054d:3639:1871643144270208:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1784938358.844664:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643144270208 offset 0 length 520: 4 00000020:00080000:2.0:1784938358.849892:0:15353:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff910cf7b0cd40) has no exports 00000020:01000000:3.0:1784938358.899963:0:15353:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910bc720c300 - data ffff910ce6f0c360/ffff910cffc19c00 00000020:01000000:3.0:1784938358.900325:0:15353:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910cfc824b40 - data ffff910ce6c06e58/ffff910cfd2bbc00 00000001:00000004:3.0:1784938358.908755:0:15353:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1784938358.962955:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784938358.962964:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1784938358.962972:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784938358.965027:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784938358.965034:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1784938358.965052:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938358.965055:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784938358.965315:0:8760:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784938358.965320:0:8760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1784938358.965334:0:8760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1784938358.966421:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784938358.966426:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:0.0:1784938358.966443:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938358.966446:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784938358.966676:0:9809:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784938358.966680:0:9809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1784938358.966690:0:9809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1784938358.968181:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59eded1 00000020:00000080:0.0:1784938358.968192:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cf7b12800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784938358.968287:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf7b12800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784938358.970203:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edee6 00000020:00000080:0.0:1784938358.970368:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cf7b14800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1784938358.970417:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1784938358.970424:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938358.970433:0:15353:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938358.970446:0:15353:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff910cf7b08000) has no exports 00000004:01000000:0.0:1784938358.970610:0:15353:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784938358.970619:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee1ef 00000020:00000080:0.0:1784938358.970624:0:15353:0:(genops.c:906:class_export_put()) final put ffff910bc67e4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938358.970992:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf7b14800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1784938358.971059:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1784938358.971064:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938358.971072:0:15353:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938358.971074:0:15353:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff910cfd203380) has no exports 00000020:00000080:0.0:1784938358.971080:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee1e8 00000020:00000080:0.0:1784938358.971085:0:15353:0:(genops.c:906:class_export_put()) final put ffff910bc7c60000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784938358.975450:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc67e4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1784938358.975916:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7c60000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1784938358.976049:0:15353:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1784938358.976054:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784938358.976058:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:0.0:1784938358.976065:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938358.976067:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784938358.976185:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938358.976198:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784938358.976207:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee0ad 00000020:00000080:0.0:1784938358.976307:0:15353:0:(genops.c:906:class_export_put()) final put ffff910bc6753000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938358.976640:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc7c63800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1784938358.976649:0:38:0:(genops.c:906:class_export_put()) final put ffff910bc67e7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938358.976651:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc67e7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1784938358.976656:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784938358.976921:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc6753000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1784938358.976950:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1784938358.976956:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938358.976964:0:15353:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938358.976969:0:15353:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff910cfd764d40) has no exports 00000020:00000080:0.0:1784938358.976975:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee0a6 00000020:00000080:0.0:1784938358.976980:0:15353:0:(genops.c:906:class_export_put()) final put ffff910bc6757800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784938358.977355:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc6757800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1784938358.977533:0:15353:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1784938358.977537:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784938358.977540:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1784938358.977546:0:15353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938358.977548:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784938358.977619:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938358.977626:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1784938358.977650:0:15353:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784938358.977656:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edf09 00000020:00000080:0.0:1784938358.977660:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cf786a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938358.978015:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc6755000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1784938358.978023:0:38:0:(genops.c:906:class_export_put()) final put ffff910cfd3b9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938358.978026:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfd3b9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1784938358.978031:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784938358.978191:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1784938358.978196:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938358.978201:0:15353:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938358.978205:0:15353:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff910cfcfb8000) has no exports 00000020:00000080:0.0:1784938358.978211:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edf02 00000020:00000080:0.0:1784938358.978354:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cfcfc6800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784938358.979688:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf786a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1784938358.981143:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfcfc6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1784938358.981368:0:15353:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1784938358.981373:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938358.981388:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1784938358.981395:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784938358.981449:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938358.981459:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784938358.981488:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938358.981491:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784938358.981495:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cf78b6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938358.981498:0:15353:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf78b6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1784938358.981505:0:15353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784938358.981686:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edeed 00000020:00000080:1.0:1784938358.981693:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cf7b12000/lustre-MDD0001_UUID 00000020:01000000:1.0:1784938358.981699:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1784938358.981703:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938358.981707:0:15353:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784938358.981711:0:15353:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff910cf7b099c0) has no exports 00000020:00000080:1.0:1784938358.981729:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938358.981733:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1784938358.981737:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edef4 00000020:00000080:1.0:1784938358.981741:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cf7b16800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1784938358.981748:0:15353:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cc481d800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1784938358.981751:0:15353:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cc481d800 2 00000020:01000004:1.0:1784938358.981753:0:15353:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff910cc481d800 from lustre-MDT0001 00000020:00000080:1.0:1784938358.981767:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938358.981770:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1784938358.981773:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cf7b16000/lustre-MDT0001_UUID 00000020:00000080:1.0:1784938358.981775:0:15353:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf7b16000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1784938358.981782:0:15353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1784938358.981811:0:15353:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1784938358.981815:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1784938358.981818:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938358.981821:0:15353:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784938358.981829:0:15353:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff910cfd138800 lustre-MDT0000-lwp-MDT0001 192.168.203.126@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938358.981913:0:15353:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff910cfd204d40) has exports, disconnecting them 00000020:00080000:1.0:1784938358.981918:0:15353:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 192.168.203.126@tcp (ffff910cfd138800), last request at 1784938095 00000020:00000080:1.0:1784938358.981922:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edf48 00000020:00080000:1.0:1784938358.981934:0:15353:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910cfd138800): rc 0 00000020:00000080:1.0:1784938358.981939:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cfd138800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1784938358.982737:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cfcfc2000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1784938358.982746:0:38:0:(genops.c:906:class_export_put()) final put ffff910cf7af7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784938358.982749:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf7af7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1784938358.982754:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784938358.982957:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf7b12000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1784938358.982962:0:38:0:(genops.c:906:class_export_put()) final put ffff910cf7b11800/lustre-MDD0001_UUID 00000020:00000080:3.0:1784938358.982964:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf7b11800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1784938358.982975:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1784938358.983185:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf7b16800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1784938358.983190:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfd138800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1784938358.999685:0:15353:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1784938358.999696:0:15353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938358.999700:0:15353:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784938358.999707:0:15353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938358.999920:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cfd13f000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1784938359.000022:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938359.000031:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1784938359.000036:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cf786f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1784938359.000039:0:15353:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf786f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1784938359.000049:0:15353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1784938359.000127:0:15353:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cc481d800 1 00000020:00000080:1.0:1784938359.000134:0:15353:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ede84 00000020:00000080:1.0:1784938359.000140:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cc487e000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1784938359.000156:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1784938359.000160:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938359.000164:0:15353:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784938359.000168:0:15353:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff910cc94319c0) has no exports 00000020:00000080:3.0:1784938359.000325:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc487e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784938359.048654:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938359.048669:0:15353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1784938359.048674:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cc481f000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784938359.048679:0:15353:0:(genops.c:865:class_export_destroy()) destroying export ffff910cc481f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1784938359.048688:0:15353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1784938359.048801:0:15353:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff910cc4818000 00000020:01000000:1.0:1784938359.048828:0:15353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1784938359.048832:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938359.048845:0:15353:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784938359.048849:0:15353:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff910cc9430000) has no exports 00000100:00100000:1.0:1784938359.048945:0:9526:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff910bc752f000:9526] 3 exiting: rc = 0 00000100:00100000:1.0:1784938359.049054:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff910cecfb8600:6513] 1 exiting: rc = 0 00000100:00100000:0.0:1784938359.049191:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff910cc2a3f000:6512] 0 exiting: rc = 1 00000100:00100000:2.0:1784938359.049453:0:13805:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff910bc73b4c00:13805] 4 exiting: rc = 0 00000100:00100000:3.0:1784938359.049832:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff910cc2a3fa00:6514] 2 exiting: rc = 0 00000100:00100000:1.0:1784938359.050083:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050092:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050098:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050104:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050109:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050115:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050121:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050127:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050133:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050138:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050145:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050150:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050160:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050166:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050172:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050178:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050184:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050189:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050195:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050200:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050205:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050210:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050451:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050456:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050475:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050481:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050486:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050492:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050498:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050504:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050516:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050531:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050536:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050541:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050547:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050552:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050557:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050561:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050566:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050572:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050577:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050582:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050587:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050593:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050599:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050606:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050612:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050617:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050622:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050627:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050740:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050747:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050753:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050758:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050768:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050774:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050780:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050786:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050791:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050797:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050802:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050807:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050812:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938359.050825:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.054812:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff910cdfb3c600:6515] 0 exiting: rc = 1 00000100:00100000:3.0:1784938359.055162:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff910cc7a5ba00:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1784938359.056398:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056413:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056420:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056425:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056431:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056437:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056442:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056448:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056454:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056461:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056467:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056518:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056533:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056538:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056571:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056579:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056585:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056590:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056595:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056600:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056605:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056611:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056616:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056621:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056638:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056643:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056648:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056652:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056657:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056661:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056666:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056672:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056676:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056681:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056686:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056691:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056695:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056700:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056704:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056709:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056714:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056719:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056724:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056729:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056734:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056739:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056744:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056749:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056754:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056758:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056764:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056769:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056775:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056779:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056784:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056788:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056792:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056798:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056803:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056815:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056820:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056825:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056830:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.056836:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938359.057365:0:7778:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff910cc943e600:7778] 2 exiting: rc = 0 00000100:00100000:2.0:1784938359.057375:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff910d019a8a00:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1784938359.057491:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff910cc7a5be00:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1784938359.057556:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057566:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057587:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057595:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057600:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057606:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057616:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057622:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057628:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057634:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057640:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057645:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057651:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057656:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057676:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057682:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057689:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057695:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057701:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057706:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057711:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057716:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057723:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057728:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057743:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057748:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057766:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057773:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057777:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057783:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057790:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057797:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057803:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057808:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057813:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057820:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057825:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057831:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057849:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057856:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057862:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057868:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057873:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057879:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057884:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057889:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057894:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057900:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057906:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057912:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057933:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057940:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057945:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057952:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057958:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057964:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057969:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057975:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057983:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.057995:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.058002:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.058386:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.058394:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938359.058399:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077493:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff910d019a8c00:6520] 1 exiting: rc = 0 00000100:00100000:3.0:1784938359.077567:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff910d019a8600:6519] 0 exiting: rc = 1 00000100:00100000:0.0:1784938359.077608:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077615:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077621:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077626:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077632:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077637:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077643:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077648:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077653:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077659:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077664:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077670:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077674:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077679:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077683:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077688:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077692:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077697:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077702:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077707:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077712:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077717:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077721:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077725:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077729:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077733:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077737:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077742:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077746:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077764:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077769:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077773:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077778:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077782:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077787:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077791:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077795:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077800:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077805:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077809:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077813:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077817:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077822:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077826:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077829:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077833:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077838:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077843:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077849:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077853:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077858:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077863:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077868:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077872:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077877:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077883:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077888:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077893:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077898:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077904:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077909:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077913:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077918:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.077922:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938359.078327:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff910d019a9400:6521] 0 exiting: rc = 1 00000100:00100000:3.0:1784938359.078401:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff910d019a9800:6522] 1 exiting: rc = 0 00000100:00100000:0.0:1784938359.078539:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078545:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078551:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078556:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078561:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078566:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078571:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078576:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078582:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078586:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078591:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078596:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078601:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078605:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078610:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078614:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078618:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078623:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078627:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078632:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078636:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078641:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078646:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078651:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078656:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078660:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078665:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078669:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078674:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078678:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078683:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078687:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078691:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078696:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078700:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078714:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078718:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078723:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078730:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078734:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078739:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078744:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078751:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078755:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078761:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078767:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078771:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078776:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078781:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078785:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078789:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078794:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078798:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078803:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078808:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078813:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078817:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078821:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078826:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078830:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078835:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078839:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078844:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.078850:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938359.079179:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff910d019a8200:6523] 0 exiting: rc = 1 00000100:00100000:2.0:1784938359.080527:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff910d019a9000:6524] 1 exiting: rc = 0 00000100:00100000:0.0:1784938359.081029:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081036:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081041:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081046:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081051:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081056:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081076:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081081:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081086:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081090:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081096:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081101:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081107:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081112:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081117:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081122:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081127:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081132:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081137:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081142:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081150:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081154:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081159:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081163:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081167:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081171:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081176:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081180:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081184:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081189:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081193:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081197:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081202:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081206:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081210:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081305:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081311:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081316:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081321:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081325:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081330:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081347:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081352:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081357:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081363:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081368:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081374:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081378:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081453:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081459:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081464:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081470:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081475:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081480:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081484:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081489:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081494:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081499:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081504:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081508:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081514:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081519:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081525:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.081530:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938359.084708:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff910cecf0f800:6526] 1 exiting: rc = 0 00000100:00100000:0.0:1784938359.086781:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff910cc598f400:6527] 2 exiting: rc = 0 00000100:00100000:1.0:1784938359.087391:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff910d019a8800:6525] 0 exiting: rc = 1 00000100:00100000:0.0:1784938359.087534:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087542:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087548:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087553:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087558:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087563:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087568:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087573:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087578:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087583:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087589:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087602:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087607:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087613:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087618:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087623:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087638:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087644:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087650:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087655:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087660:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087666:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087671:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087675:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087681:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087687:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087693:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087699:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087704:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087708:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087714:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087719:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087724:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087730:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087735:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087739:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087745:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087750:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087756:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087761:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087781:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087790:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087795:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087800:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087805:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087810:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087823:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087828:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087834:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087840:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087845:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087851:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087857:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087862:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087868:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087874:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087880:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087887:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087893:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087898:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087904:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087910:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087916:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938359.087921:0:15353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784938359.098071:0:15353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938359.098084:0:15353:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1784938359.098090:0:15353:0:(genops.c:906:class_export_put()) final put ffff910cd200e000/MDS_uuid 00000020:00000080:0.0:1784938359.098095:0:15353:0:(genops.c:865:class_export_destroy()) destroying export ffff910cd200e000/MDS_uuid for MDS 00000020:01000000:0.0:1784938359.098101:0:15353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1784938359.098302:0:15353:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1784938359.455999:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938359.456010:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784938359.456013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938359.456017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784938359.456020:0:8:0:(import.c:65:import_set_state_nolock()) ffff910bc1755800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938359.456030:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.203.126@tcp last attempt 422 00000100:00080000:0.0:1784938359.456041:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784938359.456049:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff910bc1755800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938359.456101:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfd180 x1871643144270336/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938359.456154:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938359.456157:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784938359.456159:0:8:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938359.456164:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.203.126@tcp last attempt 422 00000100:00080000:0.0:1784938359.456167:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784938359.456171:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff910bc58d5000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938359.456184:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfe680 x1871643144270592/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938359.457464:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938359.457491:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144270720:192.168.203.126@tcp:400:kworker.0 00010000:00010000:2.0:1784938359.457603:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938359.457690:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144270464:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938359.457940:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1871643144270336:192.168.203.126@tcp:38:kworker.0 00000100:00100000:1.0:1784938359.457976:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144270592:192.168.203.126@tcp:38:kworker.0 00000400:00000100:1.0:1784938359.458177:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144270720 offset 0 length 224: 4 00000400:00000100:1.0:1784938359.458649:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144270336 offset 0 length 520: 4 00000400:00000100:1.0:1784938359.458666:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144270464 offset 0 length 224: 4 00000400:00000100:1.0:1784938359.458677:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144270592 offset 0 length 520: 4 00010000:00010000:0.0:1784938360.486837:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938361.511130:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938362.527705:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784938362.889340:0:15553:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784938362.903644:0:15553:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1784938362.903724:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938362.903743:0:15553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938362.903751:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938362.903760:0:15553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938362.903837:0:15553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784938362.903843:0:15553:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784938362.903875:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938362.903894:0:15553:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffbfd180 x1871643144270336/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 1784938374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938362.903913:0:15553:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784938362.903954:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc1755800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938362.903960:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.126@tcp failed (-5) 00000100:00100000:1.0:1784938362.903983:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1871643144270336:192.168.203.126@tcp:38:kworker.0 00000100:00080000:1.0:1784938362.904020:0:15553:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784938362.904027:0:15553:0:(import.c:65:import_set_state_nolock()) ffff910bc1755800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1784938362.904033:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938362.904036:0:15553:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784938362.904039:0:15553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784938362.906654:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784938362.906679:0:15553:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffbfd880 x1871643144270464/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938375 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938362.906717:0:15553:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784938362.906725:0:15553:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784938362.906761:0:15553:0:(import.c:65:import_set_state_nolock()) ffff910bc58d3000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784938362.906819:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1871643144270848:192.168.203.126@tcp:39:umount.0 00000400:00000100:1.0:1784938362.907176:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144270848 offset 0 length 224: 4 00000100:00100000:1.0:1784938362.907311:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144270464:192.168.203.126@tcp:400:kworker.0 00010000:00010000:3.0:1784938362.915006:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938362.915028:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938362.915045:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938362.915051:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938362.915067:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938362.915076:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938362.915083:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938362.915087:0:7463:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784938362.915111:0:7463:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784938362.915192:0:7463:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910cecfca800 00010000:00010000:3.0:1784938362.915197:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938362.915283:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1800/0x26783cd1c59ee2c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee2c8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938362.915458:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938362.915460:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938362.915463:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938363.487448:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938363.487462:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938363.487465:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938363.487469:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938363.487608:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938363.487640:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144270976:192.168.203.126@tcp:400:kworker.0 00000400:00000100:2.0:1784938363.488549:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144270976 offset 0 length 224: 4 00010000:00010000:0.0:1784938363.551678:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938364.511460:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938364.511474:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938364.511478:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938364.511482:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938364.511696:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938364.511722:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144271104:192.168.203.126@tcp:400:kworker.0 00000400:00000100:2.0:1784938364.512305:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144271104 offset 0 length 224: 4 00010000:00010000:2.0:1784938364.575448:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784938365.090045:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784938365.090056:0:9509:0:(genops.c:906:class_export_put()) final put ffff910bc67e3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938365.092104:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc67e3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1784938365.092207:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc67e2000 for lustre-OST0001 00000001:00100000:0.0:1784938365.094988:0:8424:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784938365.094998:0:8424:0:(genops.c:906:class_export_put()) final put ffff910bc6754800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784938365.095087:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc6754800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784938365.095177:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc6752000 for lustre-OST0000 00010000:00010000:3.0:1784938365.600758:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938366.626035:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938367.647801:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938368.031337:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938358/real 1784938358] req@ffff910cffbfc700 x1871643144270208/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784938368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938368.031386:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910cffbfc700 x1871643144270208/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784938368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938368.031423:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cecfca800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938368.031459:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1784938368.031464:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7782ae5c-cb83-4240-bccc-1dc097db054d:3639:1871643144270208:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1784938368.032009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938368.032017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784938368.032020:0:8:0:(import.c:65:import_set_state_nolock()) ffff910cecfca800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938368.032027:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1784938368.032035:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.126@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938368.032045:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff910cecfca800 using connection 7782ae5c-cb83-4240-bccc-1dc097db054d/0@lo 00000100:00100000:3.0:1784938368.032092:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb26680 x1871643144271232/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938368.032127:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938368.032132:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938368.032313:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938368.032347:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144271360:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938368.032467:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7782ae5c-cb83-4240-bccc-1dc097db054d:3639:1871643144271232:0@lo:250:kworker.0 00000400:00000100:1.0:1784938368.032532:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643144271232 offset 0 length 520: 4 00000400:00000100:3.0:1784938368.032871:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144271360 offset 0 length 224: 4 00010000:00010000:3.0:1784938368.675548:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938369.695366:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938370.720572:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938371.743540:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938372.127316:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938362/real 1784938362] req@ffff910bc678ca80 x1871643144270848/t0(0) o39->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938372 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938372.127365:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910bc678ca80 x1871643144270848/t0(0) o39->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938372 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938372.127387:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc58d3000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784938372.127410:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1871643144270848:192.168.203.126@tcp:39:umount.0 00000100:00080000:0.0:1784938372.127499:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784938372.127529:0:15553:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784938372.127533:0:15553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784938372.128448:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938372.128462:0:15553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938372.128468:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938372.128474:0:15553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938372.128500:0:15553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938372.128507:0:15553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938372.128514:0:15553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938372.128520:0:15553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938372.128526:0:15553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938372.128546:0:15553:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784938372.128551:0:15553:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1784938372.128580:0:15553:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1784938372.128585:0:15553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1784938372.128598:0:15553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938372.128604:0:15553:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784938372.128608:0:15553:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff910cf3bf99c0) has no exports 00000020:00080000:0.0:1784938372.128628:0:15553:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff910cf3bf99c0) has no exports 00000020:01000000:0.0:1784938372.130412:0:15553:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910bc7648f00 - data ffff910ce6f205e8/ffff910cffb86800 00000020:01000000:0.0:1784938372.130526:0:15553:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910bc664a240 - data ffff910ce6e79e58/ffff910bc6768800 00010000:00010000:2.0:1784938372.130971:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938372.130980:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938372.130992:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910bc7468400 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938372.130996:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938372.131006:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938372.131031:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938372.131037:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938372.131039:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1784938372.131043:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1784938372.131058:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910cecfca800 00010000:00010000:2.0:1784938372.131062:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938372.131068:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910bc7468400/0x26783cd1c59ee2cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee2d6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938372.131080:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938372.131084:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938372.131090:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0000 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938372.131092:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938372.131099:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938372.131105:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938372.131111:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784938372.131113:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784938372.131120:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784938372.131127:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910cecfca800 00010000:00010000:2.0:1784938372.131130:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938372.131146:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0000/0x26783cd1c59ee545 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee54c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938372.131157:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938372.131159:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938372.131161:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938372.131361:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1784938372.140262:0:15553:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1784938372.155288:0:15553:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee021 00000020:00000080:0.0:1784938372.155300:0:15553:0:(genops.c:906:class_export_put()) final put ffff910bc58d7800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1784938372.155311:0:15553:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cfd213000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1784938372.155315:0:15553:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cfd213000 2 00000020:01000004:0.0:1784938372.155318:0:15553:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff910cfd213000 from lustre-OST0000 00000020:00000080:0.0:1784938372.155346:0:15553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938372.155355:0:15553:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1784938372.155358:0:15553:0:(genops.c:906:class_export_put()) final put ffff910cfd3ba000/lustre-OST0000_UUID 00000020:00000080:0.0:1784938372.155361:0:15553:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfd3ba000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1784938372.155366:0:15553:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:3.0:1784938372.155463:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc58d7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1784938372.163393:0:15553:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1784938372.163405:0:15553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1784938372.163412:0:15553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938372.163432:0:15553:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784938372.163442:0:15553:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff910bc1750000 lustre-MDT0000-lwp-OST0000 192.168.203.126@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938372.163448:0:15553:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff910cfcfb99c0) has exports, disconnecting them 00000020:00080000:3.0:1784938372.164132:0:15553:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 192.168.203.126@tcp (ffff910bc1750000), last request at 1784938117 00000020:00000080:3.0:1784938372.165098:0:15553:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee04b 00000020:00080000:3.0:1784938372.165124:0:15553:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910bc1750000): rc 0 00000020:00000080:3.0:1784938372.165130:0:15553:0:(genops.c:906:class_export_put()) final put ffff910bc1750000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1784938372.165517:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc1750000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1784938372.172323:0:15553:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784938372.172332:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784938372.172336:0:15553:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784938372.172344:0:15553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938372.172514:0:15553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938372.172524:0:15553:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1784938372.172531:0:15553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784938372.172536:0:15553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938372.172540:0:15553:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784938372.172548:0:15553:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff910bc58d6000 lustre-MDT0001-lwp-OST0000 192.168.203.126@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938372.172555:0:15553:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff910cf3bfb380) has exports, disconnecting them 00000020:00080000:2.0:1784938372.172560:0:15553:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 192.168.203.126@tcp (ffff910bc58d6000), last request at 1784938117 00000020:00000080:2.0:1784938372.172564:0:15553:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee060 00000020:00080000:2.0:1784938372.172581:0:15553:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910bc58d6000): rc 0 00000020:00000080:2.0:1784938372.172587:0:15553:0:(genops.c:906:class_export_put()) final put ffff910bc58d6000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1784938372.172999:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc1755800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784938372.173007:0:8:0:(genops.c:906:class_export_put()) final put ffff910bc1754000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1784938372.173010:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc1754000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1784938372.173016:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1784938372.173083:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc58d6000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1784938372.178270:0:15553:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784938372.178281:0:15553:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784938372.178285:0:15553:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784938372.178292:0:15553:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784938372.178320:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc58d3000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1784938372.178474:0:15553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938372.178484:0:15553:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1784938372.178489:0:15553:0:(genops.c:906:class_export_put()) final put ffff910bc58d0000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1784938372.178504:0:15553:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc58d0000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1784938372.178515:0:15553:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1784938372.178577:0:15553:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cfd213000 1 00000020:00000080:0.0:1784938372.178589:0:15553:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edfe9 00000020:00000080:0.0:1784938372.178598:0:15553:0:(genops.c:906:class_export_put()) final put ffff910cf7984800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1784938372.178609:0:15553:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1784938372.178616:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf7984800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784938372.178626:0:15553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938372.178630:0:15553:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784938372.178634:0:15553:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff910cfcfbcd40) has no exports 00000020:00000080:0.0:1784938372.221719:0:15553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938372.221735:0:15553:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1784938372.221741:0:15553:0:(genops.c:906:class_export_put()) final put ffff910cfd214000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1784938372.221746:0:15553:0:(genops.c:865:class_export_destroy()) destroying export ffff910cfd214000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1784938372.221755:0:15553:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1784938372.221879:0:15553:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff910cfd217000 00000020:02000400:0.0:1784938372.221930:0:15553:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1784938372.771054:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938373.281025:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938373.281037:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938373.281057:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938373.281062:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784938373.281302:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144271488:192.168.203.126@tcp:400:kworker.0 00000400:00000100:1.0:1784938373.281573:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144271488 offset 0 length 224: 4 00010000:00010000:2.0:1784938373.791329:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938374.177652:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938359/real 1784938359] req@ffff910cffbfe680 x1871643144270592/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938374.177696:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910cffbfe680 x1871643144270592/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 1 dl 1784938374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938374.177717:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938374.177846:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:1.0:1784938374.177851:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144270592:192.168.203.126@tcp:38:kworker.0 00000100:00080000:3.0:1784938374.178102:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938374.178109:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784938374.178112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784938374.178116:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938374.178119:0:8:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938374.178137:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.203.126@tcp last attempt 427 00000100:00080000:3.0:1784938374.178148:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784938374.178155:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff910bc58d5000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938374.178187:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb27100 x1871643144271616/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938374.178279:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144271744:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938374.178410:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144271616:192.168.203.126@tcp:38:kworker.0 00000400:00000100:1.0:1784938374.178612:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144271744 offset 0 length 224: 4 00000400:00000100:1.0:1784938374.178827:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144271616 offset 0 length 520: 4 00010000:00010000:1.0:1784938374.819866:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1784938375.199296:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938359/real 1784938359] req@ffff910cffbfca80 x1871643144270720/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938375 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938375.227922:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff910cffbfca80 x1871643144270720/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938375 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938375.227937:0:3643:0:(import.c:65:import_set_state_nolock()) ffff910bc1755000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784938375.227942:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 192.168.203.126@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784938375.253848:0:3643:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1784938375.254052:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938375.254070:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938375.254074:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938375.254077:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938375.254079:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938375.254082:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784938375.254085:0:38:0:(import.c:65:import_set_state_nolock()) ffff910bc1755000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938375.254095:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 192.168.203.126@tcp last attempt 211 00000100:00080000:2.0:1784938375.254109:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff910bc1755000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938375.254366:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cd2072d80 x1871643144271872/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938375.254416:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144270720:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938375.254597:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1871643144271872:192.168.203.126@tcp:38:kworker.0 00000400:00000100:2.0:1784938375.257716:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 12 match 1871643144271872 offset 0 length 520: 4 00000020:01000004:1.0:1784938375.509347:0:15755:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784938375.526552:0:15755:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1784938375.526644:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.526659:0:15755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.526667:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.526688:0:15755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.526714:0:15755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784938375.526719:0:15755:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784938375.526753:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938375.526768:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffb27100 x1871643144271616/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 1784938394 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784938375.526854:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938375.526861:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938375.526869:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0e00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:0.0:1784938375.526873:0:7463:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938375.526882:0:7463:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938375.526890:0:7463:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938375.526905:0:7463:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938375.526908:0:7463:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784938375.526911:0:7463:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784938375.526926:0:7463:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910cecfca800 00010000:00010000:0.0:1784938375.526930:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938375.526936:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0e00/0x26783cd1c59ee2a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee2ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938375.526947:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938375.526949:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938375.526951:0:7463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938375.526977:0:15755:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784938375.526984:0:15755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784938375.526990:0:15755:0:(import.c:65:import_set_state_nolock()) ffff910bc58d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1784938375.526995:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938375.527000:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffb27100 x1871643144271616/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 1784938394 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938375.527060:0:15755:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784938375.531752:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144271616:192.168.203.126@tcp:38:kworker.0 00000100:00100000:1.0:1784938375.531950:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784938375.533753:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784938375.533771:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910bc678dc00 x1871643144270976/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938379 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938375.533791:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910bc678d180 x1871643144271104/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938380 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938375.533918:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144270976:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938375.534005:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffb24700 x1871643144271360/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938384 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938375.534026:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910bc678ca80 x1871643144271488/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938389 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938375.534034:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffb24a80 x1871643144271744/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938390 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938375.534063:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cd2072d80 x1871643144271872/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 1784938385 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938375.534074:0:15755:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784938375.534079:0:15755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784938375.534127:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144271360:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938375.534151:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1871643144271104:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938375.534186:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144271488:192.168.203.126@tcp:400:kworker.0 00000100:00080000:3.0:1784938375.534231:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc1755000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938375.534236:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.203.126@tcp failed (-5) 00000100:00100000:3.0:1784938375.534240:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1871643144271872:192.168.203.126@tcp:38:kworker.0 00000100:00100000:3.0:1784938375.534276:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144271744:192.168.203.126@tcp:400:kworker.0 00000100:00080000:1.0:1784938375.537760:0:15755:0:(import.c:65:import_set_state_nolock()) ffff910bc1755000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1784938375.537775:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784938375.537788:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910bc678d180 x1871643144271104/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938380 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938375.537803:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffb24700 x1871643144271360/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938384 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938375.537812:0:15755:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784938375.537817:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784938375.542475:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.542495:0:15755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.542502:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.542508:0:15755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.542531:0:15755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938375.542538:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.542561:0:15755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.542567:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.542573:0:15755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938375.542687:0:15755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784938375.542692:0:15755:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1784938375.542721:0:15755:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784938375.542725:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1784938375.542729:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938375.542734:0:15755:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784938375.542738:0:15755:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff910bc71599c0) has no exports 00000020:00080000:1.0:1784938375.542760:0:15755:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff910bc71599c0) has no exports 00000020:01000000:1.0:1784938375.544462:0:15755:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910cc9a09000 - data ffff910ce6e92510/ffff910bc77cb800 00000020:01000000:1.0:1784938375.544629:0:15755:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff910bc7648c00 - data ffff910ce6f0bbd0/ffff910bc76a0400 00010000:00010000:3.0:1784938375.548138:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938375.548155:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938375.550113:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1a00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938375.550130:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938375.550143:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938375.550151:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938375.550156:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938375.550177:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1784938375.550180:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1784938375.550200:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910cecfca800 00010000:00010000:3.0:1784938375.550205:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938375.550226:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a1a00/0x26783cd1c59ee2b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee2ba expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938375.550245:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938375.550249:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938375.550255:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0400 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938375.550258:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938375.550265:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938375.550271:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938375.550277:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784938375.550279:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784938375.550281:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784938375.550286:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910cecfca800 00010000:00010000:3.0:1784938375.550289:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938375.550294:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ee537 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee53e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938375.550315:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938375.550317:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938375.550321:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938375.550807:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1784938375.566457:0:15755:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1784938375.570922:0:15755:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee147 00000020:00000080:0.0:1784938375.570934:0:15755:0:(genops.c:906:class_export_put()) final put ffff910bc7163800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1784938375.570945:0:15755:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cece6d800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1784938375.570948:0:15755:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cece6d800 2 00000020:01000004:0.0:1784938375.570951:0:15755:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff910cece6d800 from lustre-OST0001 00000020:00000080:3.0:1784938375.570968:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7163800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1784938375.570983:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938375.570993:0:15755:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1784938375.570997:0:15755:0:(genops.c:906:class_export_put()) final put ffff910bc58d2000/lustre-OST0001_UUID 00000020:00000080:0.0:1784938375.570999:0:15755:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc58d2000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1784938375.571006:0:15755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1784938375.572322:0:15755:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7782ae5c-cb83-4240-bccc-1dc097db054d->MGS 00010000:00010000:0.0:1784938375.572342:0:15755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cc0030c00/0x26783cd1c59edea0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59edea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938375.572372:0:15755:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cc0030c00/0x26783cd1c59edea0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59edea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938375.572378:0:15755:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1784938375.572380:0:15755:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1784938375.572384:0:15755:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1784938375.572409:0:15755:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910cecfca800 00010000:00010000:0.0:1784938375.572414:0:15755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cc0030c00/0x26783cd1c59edea0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59edea7 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938375.572435:0:15755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x26783cd1c59ee31c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938375.572443:0:15755:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x26783cd1c59ee31c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938375.572448:0:15755:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784938375.572450:0:15755:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1784938375.572452:0:15755:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1784938375.572461:0:15755:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910cecfca800 00010000:00010000:0.0:1784938375.572464:0:15755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ee315 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x26783cd1c59ee31c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784938375.572480:0:15755:0:(import.c:65:import_set_state_nolock()) ffff910cecfca800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1784938375.572484:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784938375.572486:0:15755:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784938375.572488:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784938375.572492:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784938375.572502:0:15755:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff910cffb26680 x1871643144271232/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784938383 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784938375.572614:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784938375.572617:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1784938375.572670:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7782ae5c-cb83-4240-bccc-1dc097db054d:3639:1871643144271232:0@lo:250:kworker.0 10000000:01000000:0.0:1784938375.572844:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784938375.572851:0:15755:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59edd9d 00000020:00000080:0.0:1784938375.572858:0:15755:0:(genops.c:906:class_export_put()) final put ffff910cd200f800/7782ae5c-cb83-4240-bccc-1dc097db054d 00000020:01000000:0.0:1784938375.572876:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.126@tcp (flags='') 00000020:00000080:0.0:1784938375.572886:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938375.572892:0:15755:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.126@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784938375.572896:0:15755:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff910cf3bf8000) has no exports 00000020:00000080:3.0:1784938375.572923:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910cd200f800/7782ae5c-cb83-4240-bccc-1dc097db054d for MGC192.168.203.126@tcp 10000000:01000000:2.0:1784938375.572972:0:6510:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1784938375.573159:0:15755:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.126@tcp: client import never connected 00000100:00080000:0.0:1784938375.573163:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1784938375.573165:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784938375.573167:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1784938375.573169:0:15755:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784938375.573236:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938375.573243:0:15755:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.126@tcp (uuid 7782ae5c-cb83-4240-bccc-1dc097db054d) 00000020:01000000:0.0:1784938375.573250:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1784938375.573253:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938375.573257:0:15755:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784938375.573263:0:15755:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff910bc58d4000 lustre-MDT0000-lwp-OST0001 192.168.203.126@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938375.573268:0:15755:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff910cfcfbb380) has exports, disconnecting them 00000020:00080000:0.0:1784938375.573272:0:15755:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 192.168.203.126@tcp (ffff910bc58d4000), last request at 1784938143 00000020:00000080:0.0:1784938375.573275:0:15755:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee171 00000020:00080000:0.0:1784938375.573285:0:15755:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910bc58d4000): rc 0 00000020:00000080:0.0:1784938375.573289:0:15755:0:(genops.c:906:class_export_put()) final put ffff910bc58d4000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1784938375.573637:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910cecfca800 for MGC192.168.203.126@tcp 00000020:00000080:3.0:1784938375.573645:0:8:0:(genops.c:906:class_export_put()) final put ffff910cecfcc800/7782ae5c-cb83-4240-bccc-1dc097db054d 00000020:00000080:3.0:1784938375.573647:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910cecfcc800/7782ae5c-cb83-4240-bccc-1dc097db054d for MGC192.168.203.126@tcp 00000020:01000000:3.0:1784938375.573652:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.126@tcp (7782ae5c-cb83-4240-bccc-1dc097db054d) 00000020:00000080:3.0:1784938375.573935:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc58d4000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1784938375.584487:0:15755:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784938375.584497:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784938375.584502:0:15755:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784938375.584512:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938375.584682:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938375.584692:0:15755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1784938375.584700:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1784938375.584704:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938375.584709:0:15755:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784938375.584717:0:15755:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff910bc7162000 lustre-MDT0001-lwp-OST0001 192.168.203.126@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938375.584733:0:15755:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff910bc7540000) has exports, disconnecting them 00000020:00080000:2.0:1784938375.584737:0:15755:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 192.168.203.126@tcp (ffff910bc7162000), last request at 1784938143 00000020:00000080:2.0:1784938375.584742:0:15755:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee186 00000020:00080000:2.0:1784938375.584759:0:15755:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.126@tcp (ffff910bc7162000): rc 0 00000020:00000080:2.0:1784938375.584766:0:15755:0:(genops.c:906:class_export_put()) final put ffff910bc7162000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1784938375.585452:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc58d5000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1784938375.585462:0:8:0:(genops.c:906:class_export_put()) final put ffff910bc58d7000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1784938375.585465:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc58d7000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1784938375.585472:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1784938375.585544:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc7162000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1784938375.585693:0:15755:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1784938375.585697:0:15755:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784938375.585700:0:15755:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784938375.585705:0:15755:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784938375.585724:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff910bc1755000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1784938375.614839:0:7463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1784938375.615399:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1784938375.615621:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1784938375.616201:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff910cca12a600:6496] 0 exiting: rc = 1 00000100:00100000:3.0:1784938375.616417:0:13728:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff910bc73cc400:13728] 2 exiting: rc = 0 00000100:00100000:1.0:1784938375.616563:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff910cca12b600:6497] 1 exiting: rc = 0 00000100:00100000:0.0:1784938375.616626:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.617292:0:7921:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff910cfd16a400:7921] 3 exiting: rc = 0 00000100:00100000:0.0:1784938375.617358:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff910cca12aa00:6498] 0 exiting: rc = 1 00000100:00100000:1.0:1784938375.617461:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff910cc7a8fc00:6499] 1 exiting: rc = 0 00000100:00100000:3.0:1784938375.617872:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff910cd1718000:6500] 2 exiting: rc = 0 00000100:00100000:0.0:1784938375.618819:0:9518:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff910cc9451600:9518] 4 exiting: rc = 0 00000100:00100000:3.0:1784938375.618940:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.618948:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.618955:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.618962:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.618967:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.618974:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.618980:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.618985:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.618991:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.618997:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619003:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619009:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619014:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619020:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619027:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619033:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619045:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619052:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619059:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619065:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619072:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619078:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619083:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619088:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619094:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619100:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619106:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619111:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619126:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619132:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619137:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619143:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619148:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619155:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619160:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619175:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619181:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619186:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619191:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619196:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619201:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619205:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619211:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619237:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619242:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619246:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619258:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619264:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619269:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619274:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619279:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619285:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619289:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619295:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619300:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619306:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619311:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619316:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619320:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619326:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619331:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619336:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619341:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.619346:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784938375.620657:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938375.620668:0:15755:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1784938375.620673:0:15755:0:(genops.c:906:class_export_put()) final put ffff910bc58d6800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1784938375.620677:0:15755:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc58d6800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1784938375.620683:0:15755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1784938375.620833:0:15755:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cece6d800 1 00000020:00000080:3.0:1784938375.620840:0:15755:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x26783cd1c59ee116 00000020:00000080:3.0:1784938375.620846:0:15755:0:(genops.c:906:class_export_put()) final put ffff910bc5b2a000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1784938375.620866:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1784938375.620870:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938375.620875:0:15755:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784938375.620879:0:15755:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff910cfd7619c0) has no exports 00000020:00000080:0.0:1784938375.620905:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff910bc5b2a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1784938375.665840:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938375.665856:0:15755:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1784938375.665862:0:15755:0:(genops.c:906:class_export_put()) final put ffff910cece6b800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1784938375.665867:0:15755:0:(genops.c:865:class_export_destroy()) destroying export ffff910cece6b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1784938375.665872:0:15755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1784938375.666570:0:15755:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffff910cece68000 00000020:01000000:3.0:1784938375.666593:0:15755:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1784938375.666598:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938375.666602:0:15755:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784938375.666607:0:15755:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff910cfd760000) has no exports 00000020:00000080:3.0:1784938375.666629:0:15755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938375.666635:0:15755:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1784938375.666639:0:15755:0:(genops.c:906:class_export_put()) final put ffff910cf7983000/OSS_uuid 00000020:00000080:3.0:1784938375.666641:0:15755:0:(genops.c:865:class_export_destroy()) destroying export ffff910cf7983000/OSS_uuid for OSS 00000020:01000000:3.0:1784938375.666645:0:15755:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1784938375.667010:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff910cfd2b5000:8431] 2 exiting: rc = 0 00000100:00100000:2.0:1784938375.667271:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff910cc2a3f200:8430] 1 exiting: rc = 0 00000100:00080000:1.0:1784938375.667455:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1784938375.667708:0:8770:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff910cfb3c5a00:8770] 3 exiting: rc = 0 00000100:00100000:1.0:1784938375.667805:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff910cfd2be400:8429] 0 exiting: rc = 1 00000100:00100000:3.0:1784938375.667884:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667894:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667899:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667911:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667921:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667927:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667932:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667937:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667942:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667948:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.667954:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668028:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668049:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668054:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668060:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668065:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668071:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668077:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668082:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668088:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668093:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668098:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668104:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668108:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668113:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668193:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668199:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668205:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668210:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668467:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668473:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668478:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668484:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668488:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668493:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668498:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668504:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668509:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668520:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668527:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668533:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668538:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668543:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668548:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668553:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668557:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668629:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668645:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668651:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668656:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668661:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668666:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668672:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668678:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668683:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668688:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668694:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668699:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668704:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668709:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668715:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668720:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668725:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.668736:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.670290:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff910cfd725800:8432] 0 exiting: rc = 1 00000100:00100000:1.0:1784938375.670591:0:14169:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff910bc77b1800:14169] 2 exiting: rc = 0 00000100:00100000:0.0:1784938375.670812:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff910cfd09a600:8433] 1 exiting: rc = 0 00000100:00100000:3.0:1784938375.671074:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671091:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671101:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671106:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671112:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671197:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671203:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671209:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671288:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671294:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671300:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671305:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671310:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671315:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671320:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671340:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671347:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671351:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671368:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671373:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671379:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671384:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671389:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671394:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671399:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671404:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671410:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671415:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671420:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671425:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671430:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671435:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671439:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671444:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671448:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671453:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671458:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671469:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671477:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671482:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671487:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671492:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671498:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671503:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671508:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671513:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671519:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671524:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671529:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671534:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671539:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671543:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671548:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671566:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671572:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671577:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671588:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671594:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671599:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671605:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671610:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671615:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671621:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.671626:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.673701:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff910cfd309400:8435] 1 exiting: rc = 0 00000100:00100000:1.0:1784938375.674170:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff910cfd724800:8436] 2 exiting: rc = 0 00000100:00100000:2.0:1784938375.677864:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff910cfd724a00:8434] 0 exiting: rc = 1 00000100:00100000:3.0:1784938375.678372:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678381:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678387:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678393:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678398:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678403:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678408:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678413:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678418:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678423:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678430:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678435:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678441:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678447:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678453:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678460:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678466:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678472:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678477:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678499:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678507:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678513:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678519:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678537:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678542:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678548:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678553:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678558:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678728:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678734:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678740:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678745:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678752:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678757:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678763:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678769:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678775:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678780:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678786:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678791:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678797:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678802:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678808:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678828:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678839:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678845:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678851:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678856:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678861:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678866:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678871:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678877:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678883:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678888:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678894:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678900:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678906:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678911:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678924:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678930:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678936:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678952:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678966:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.678973:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938375.688678:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff910cd15ff600:8437] 0 exiting: rc = 1 00000100:00100000:3.0:1784938375.689486:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff910cfd724000:8438] 1 exiting: rc = 0 00000100:00100000:2.0:1784938375.689599:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689607:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689612:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689617:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689622:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689626:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689632:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689637:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689642:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689647:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689653:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689658:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689664:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689669:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689674:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689679:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689684:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689689:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689693:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689698:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689703:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689708:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689714:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689719:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689738:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689743:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689748:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689753:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689758:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689764:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689769:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689775:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689780:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689785:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689789:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689794:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689798:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689803:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689807:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689812:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689817:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689822:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689827:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689833:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689837:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689842:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689848:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689853:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689858:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689863:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689868:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689873:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689878:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689883:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689889:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689894:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689900:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689905:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689910:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689924:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689930:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689935:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689940:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938375.689954:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938375.692540:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff910cfd725000:8439] 0 exiting: rc = 1 00000100:00100000:3.0:1784938375.693280:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff910bc1416600:8440] 1 exiting: rc = 0 00000100:00100000:3.0:1784938375.693355:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693363:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693369:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693375:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693380:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693387:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693393:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693399:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693427:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693434:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693439:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693445:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693451:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693459:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693466:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693472:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693478:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693484:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693489:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693494:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693516:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693523:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693531:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693537:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693543:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693550:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693556:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693587:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693592:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693598:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693603:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693609:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693628:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693636:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693641:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693646:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693652:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693657:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693663:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693668:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693675:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693680:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693686:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693692:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693711:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693718:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693724:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693730:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693735:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693741:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693747:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693753:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693759:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693765:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693770:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693775:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693793:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693801:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693808:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693813:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693819:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693825:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693836:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938375.693842:0:15755:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1784938375.717006:0:15755:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1784938394.756339:0:16519:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784938403.950045:0:17118:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:0.0:1784938403.950052:0:17118:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784938403.950054:0:17118:0:(obd_mount.c:925:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784938403.950774:0:17118:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff910cc871e000 00000020:01000004:0.0:1784938403.950792:0:17118:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784938403.950800:0:17118:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784938403.950813:0:17118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff910cfd760000) 00000020:00000080:0.0:1784938403.950827:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784938404.028060:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784938404.028969:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784938404.030814:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784938404.031177:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.031672:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.031917:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.032368:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.032674:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.033015:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.033528:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.033748:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.034119:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.034557:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.034763:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.035144:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.035690:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.036114:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.036564:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.036771:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.037080:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.037682:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.038159:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.038656:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.038955:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.039463:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.039691:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.039962:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.040555:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.040809:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.041522:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.041790:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784938404.042178:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.042634:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.042975:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1784938404.044719:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784938404.045662:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784938404.045990:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784938404.046563:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784938404.047348:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784938404.047740:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784938404.048061:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784938404.048482:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784938404.048714:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784938404.049758:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1784938404.050453:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784938404.050725:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1784938404.052712:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1784938404.055657:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1784938404.056248:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1784938404.056511:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1784938404.056867:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1784938404.057498:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1784938404.057722:0:17118:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1784938404.058810:0:17118:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784938404.059043:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784938404.059488:0:17118:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784938404.059503:0:17118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ef35a 00000020:01000004:1.0:1784938404.059511:0:17118:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784938404.059515:0:17118:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784938404.059522:0:17118:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910cc871e000 from MGS 00000020:01000004:1.0:1784938404.059526:0:17118:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784938404.059537:0:17118:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff910cfd204d40) 00000020:00000080:1.0:1784938404.059546:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1784938404.059610:0:17118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cc871e000 from MGS, refs=2 00080000:01000000:1.0:1784938404.059615:0:17118:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784938404.059620:0:17118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ef368 00000100:00100000:1.0:1784938404.059727:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1784938404.059844:0:17118:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1784938404.059850:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1784938404.060827:0:17118:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1784938404.060843:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1784938404.062677:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938404.062827:0:17118:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1784938404.063036:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784938404.067044:0:17118:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784938404.067124:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1784938404.068554:0:17118:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784938404.068564:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784938404.070741:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938404.070746:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938404.070748:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938404.071520:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938404.071524:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938404.071526:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938404.072530:0:17118:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784938404.074208:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1784938404.079620:0:17118:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784938404.080850:0:17130:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784938404.081126:0:17118:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784938404.081283:0:17118:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784938404.082256:0:17118:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784938404.082819:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938404.084489:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784938404.084500:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784938404.097804:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784938404.097818:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784938404.100098:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784938404.100109:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784938404.103583:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784938404.103612:0:17118:0:(obd_mount.c:414:lustre_start_mgc()) Start MGC 'MGC192.168.203.126@tcp' 00000020:01000004:3.0:1784938404.103614:0:17118:0:(obd_mount.c:423:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784938404.103640:0:17118:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGC192.168.203.126@tcp (typ=mgc) 00000020:00000080:3.0:1784938404.103653:0:17118:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.126@tcp (ffff910bc715b380) 00000020:00000080:3.0:1784938404.103670:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784938404.103751:0:17118:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910cd0e86000@MGC192.168.203.126@tcp: add connection 0@lo at head 00010000:00010000:3.0:1784938404.103910:0:17118:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.126@tcp-0 is initialized 00000040:01000000:3.0:1784938404.103917:0:17118:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 1 is initialized 00000100:00080000:0.0:1784938404.106862:0:17135:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1784938404.106901:0:17136:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1784938404.106990:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.126@tcp (uuid 22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc) 00000020:00000080:3.0:1784938404.107012:0:17118:0:(genops.c:1406:class_connect()) connect: client 22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc, cookie 0x26783cd1c59ef376 00000100:00080000:3.0:1784938404.107024:0:17118:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784938404.107031:0:17118:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff910cd0e86000 using connection 22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc/0@lo 00000100:00100000:3.0:1784938404.107071:0:17118:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb25180 x1871643144272000/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938404.107108:0:17118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc->MGS 00000020:01000004:3.0:1784938404.107142:0:17118:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784938404.107148:0:17118:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1784938404.107161:0:17118:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff910bc7158000) 00000020:00000080:3.0:1784938404.107175:0:17118:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784938404.107657:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3639:1871643144272000:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784938404.107723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938404.107851:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144272000 00000100:00100000:3.0:1784938404.107859:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144272000 00000100:00100000:3.0:1784938404.107895:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784938404.107901:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1871643144272000:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1784938404.107924:0:17131:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1784938404.107956:0:17131:0:(genops.c:1406:class_connect()) connect: client 22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc, cookie 0x26783cd1c59ef384 00000100:00080000:3.0:1784938404.108083:0:17131:0:(import.c:65:import_set_state_nolock()) ffff910cfd212800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938404.108152:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+5:3639:x1871643144272000:12345-0@lo:250:mount.lustre.0 Request processed in 249us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938404.108159:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784938404.108201:0:3639:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784938404.108210:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.126@tcp: connect to target with instance 0 00000100:00080000:3.0:1784938404.108239:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784938404.108242:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784938404.108245:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cd0e86000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784938404.108248:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784938404.108254:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784938404.108258:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3639:1871643144272000:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784938404.126317:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938404.126548:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784938404.126555:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784938404.131340:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784938404.131357:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784938404.132030:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784938404.132037:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784938404.133485:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938404.133649:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784938404.133654:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784938404.140705:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784938404.140720:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1784938404.190832:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938404.191210:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784938404.191291:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784938404.192558:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1784938404.192567:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784938404.193081:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938404.193268:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938404.193273:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784938404.193855:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784938404.193862:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1784938404.194475:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938404.194659:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938404.194664:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784938404.195081:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784938404.195087:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1784938404.195748:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938404.195877:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938404.195883:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1784938404.197833:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784938404.197846:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784938404.264285:0:17118:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938404.264647:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784938404.264654:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784938404.266627:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784938404.266642:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1784938404.267643:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784938404.267653:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1784938404.272510:0:17118:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1784938404.272720:0:17118:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784938404.272727:0:17118:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784938404.272918:0:17118:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784938404.273023:0:17118:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784938404.273027:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784938404.273029:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938404.273030:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938404.273031:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938404.273032:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938404.273033:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938404.273035:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938404.273036:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938404.273038:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938404.273039:0:17118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938404.273041:0:17118:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784938404.273044:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938404.273045:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938404.273046:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938404.273047:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938404.273048:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938404.273049:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938404.273050:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938404.273051:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938404.273052:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938404.273053:0:17118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938404.273080:0:17118:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784938404.273099:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272128:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784938404.273167:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938404.273283:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938404.273480:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144272128 00000100:00100000:2.0:1784938404.273487:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144272128 00000100:00100000:2.0:1784938404.273627:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784938404.273637:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+5:17118:x1871643144272128:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938404.273684:0:17134:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784938404.273687:0:17134:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784938404.273690:0:17134:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1784938404.274958:0:17155:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1784938404.275467:0:17134:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1784938404.287308:0:17156:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784938404.287317:0:17156:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1784938404.287320:0:17156:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784938404.287322:0:17156:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784938404.288033:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1784938404.288634:0:17134:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784938404.288646:0:17134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784938404.297107:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+5:17118:x1871643144272128:12345-0@lo:253:mount.lustre.0 Request processed in 23462us (23931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.297132:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784938404.298778:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272128:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784938404.298800:0:17118:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784938404.298803:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938404.298805:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938404.298807:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938404.298822:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938404.298824:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938404.298825:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938404.298826:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938404.298829:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938404.298831:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938404.298833:0:17118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784938404.299445:0:17118:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910cc871e000 from lustre-MDT0000 10000000:01000000:0.0:1784938404.299482:0:17118:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784938404.299486:0:17118:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784938404.299491:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff910bc715b380 10000000:01000000:0.0:1784938404.299495:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938404.299503:0:17118:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff910bc715b380 from 1 10000000:01000000:0.0:1784938404.299506:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784938404.299559:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938404.299571:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938404.299581:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938404.299601:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938404.299662:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938404.299708:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d01540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938404.299770:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144272256 00000100:00100000:2.0:1784938404.299777:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144272256 00000100:00100000:2.0:1784938404.299827:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784938404.299836:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+5:17118:x1871643144272256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938404.299849:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938404.299863:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cffbc0e00/0x26783cd1c59ef392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef38b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.299887:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cffbc0e00/0x26783cd1c59ef392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef38b expref: 6 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.299913:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cffbc0e00/0x26783cd1c59ef392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef38b expref: 6 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.299923:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0e00, rc 0) 00000100:00100000:2.0:1784938404.299993:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+6:17118:x1871643144272256:12345-0@lo:101:mount.lustre.0 Request processed in 156us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.299999:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784938404.300146:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938404.300160:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.300168:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938404.300256:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938404.300284:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.300301:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938404.300369:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144272384 00000100:00100000:0.0:1784938404.300374:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144272384 00000100:00100000:0.0:1784938404.300397:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784938404.300403:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+6:17118:x1871643144272384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938404.300482:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+6:17118:x1871643144272384:12345-0@lo:501:mount.lustre.0 Request processed in 79us (197us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938404.300500:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938404.300635:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272384:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784938404.300663:0:17118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784938404.300681:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.300689:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938404.300697:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910cc871e000 10000000:01000000:1.0:1784938404.300701:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784938404.300705:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff910cc871e000 10000000:01000000:1.0:1784938404.300707:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784938404.300710:0:17118:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff910cc871e000 from 1 10000000:01000000:1.0:1784938404.300712:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784938404.300736:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59ef399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.300744:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59ef399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.300752:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59ef399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938404.300764:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938404.300790:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.300808:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938404.301039:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144272512 00000100:00100000:2.0:1784938404.301044:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144272512 00000100:00100000:2.0:1784938404.301067:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784938404.301074:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+6:17118:x1871643144272512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938404.301082:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938404.301094:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cffbc0c00/0x26783cd1c59ef3a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef399 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.301109:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cffbc0c00/0x26783cd1c59ef3a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef399 expref: 7 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.301117:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cffbc0c00/0x26783cd1c59ef3a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef399 expref: 7 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.301124:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0c00, rc 0) 00000100:00100000:2.0:1784938404.301153:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+7:17118:x1871643144272512:12345-0@lo:101:mount.lustre.0 Request processed in 80us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.301159:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784938404.301251:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938404.301262:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59ef399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef3a0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.301270:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59ef399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef3a0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938404.301280:0:17118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784938404.301284:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59ef399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef3a0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.301290:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d0215bc00/0x26783cd1c59ef399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef3a0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938404.301296:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784938404.301300:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938404.301304:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff910cc871e000 10000000:01000000:1.0:1784938404.301313:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784938404.301316:0:17118:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784938404.301318:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784938404.301332:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215ba00/0x26783cd1c59ef3a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.301338:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d0215ba00/0x26783cd1c59ef3a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.301344:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215ba00/0x26783cd1c59ef3a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938404.301355:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938404.301381:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.301396:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938404.301466:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144272640 00000100:00100000:2.0:1784938404.301470:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144272640 00000100:00100000:2.0:1784938404.301499:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784938404.301505:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+7:17118:x1871643144272640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938404.301512:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938404.301520:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cffbc0000/0x26783cd1c59ef3ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef3a7 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.301536:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cffbc0000/0x26783cd1c59ef3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef3a7 expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.301544:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cffbc0000/0x26783cd1c59ef3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef3a7 expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.301549:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc0000, rc 0) 00000100:00100000:2.0:1784938404.301575:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+8:17118:x1871643144272640:12345-0@lo:101:mount.lustre.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.301581:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938404.301659:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938404.301670:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215ba00/0x26783cd1c59ef3a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef3ae expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.301677:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215ba00/0x26783cd1c59ef3a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef3ae expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938404.301721:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938404.301747:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.301768:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938404.301830:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144272768 00000100:00100000:2.0:1784938404.301835:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144272768 00000100:00100000:2.0:1784938404.301857:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784938404.301862:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+8:17118:x1871643144272768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938404.301996:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+9:17118:x1871643144272768:12345-0@lo:501:mount.lustre.0 Request processed in 132us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.302002:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938404.302210:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938404.302271:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938404.302310:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.302332:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938404.302408:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144272896 00000100:00100000:0.0:1784938404.302411:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144272896 00000100:00100000:0.0:1784938404.302436:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784938404.302442:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd583850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+9:17118:x1871643144272896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938404.303321:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd583850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+9:17118:x1871643144272896:12345-0@lo:503:mount.lustre.0 Request processed in 875us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938404.303329:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784938404.303418:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144272896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938404.305120:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17157:1871643144273024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938404.305193:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.305257:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4d600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938404.305329:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144273024 00000100:00100000:2.0:1784938404.305336:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144273024 00000100:00100000:2.0:1784938404.305381:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784938404.305389:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+9:17157:x1871643144273024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938404.306461:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+9:17157:x1871643144273024:12345-0@lo:502:llog_process_th.0 Request processed in 1068us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.306478:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938404.306583:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17157:1871643144273024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938404.306613:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938404.306623:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938404.306626:0:17157:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784938404.306631:0:17157:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784938404.306634:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938404.306649:0:17157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff910cfd203380) 00000020:00000080:1.0:1784938404.306665:0:17157:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1784938404.306670:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784938404.306745:0:17157:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784938404.306752:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ef3bc 00000020:00000080:1.0:1784938404.307009:0:17157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784938404.307014:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938404.307018:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938404.307019:0:17157:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784938404.307022:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938404.307025:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938404.307026:0:17157:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784938404.307029:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938404.307037:0:17157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff910cfd200000) 00000020:00000080:1.0:1784938404.307046:0:17157:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1784938404.307050:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784938404.307052:0:17157:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784938404.307054:0:17157:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784938404.307060:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784938404.307124:0:17157:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cc871e000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784938404.307137:0:17157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff910cfd2019c0) 00000020:00000080:1.0:1784938404.307146:0:17157:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1784938404.307207:0:17157:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784938404.307249:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ef3d1 00000020:00000080:1.0:1784938404.307339:0:17157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784938404.307345:0:17157:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784938404.307350:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x26783cd1c59ef3d8 00080000:01000000:1.0:1784938404.307354:0:17157:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784938404.307358:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ef3df 00010000:00010000:3.0:1784938404.410453:0:17157:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1784938404.418078:0:17157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1784938404.421530:0:17157:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784938404.421991:0:17157:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff910bc715cd40) 00000020:00000080:3.0:1784938404.422009:0:17157:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784938404.422099:0:17157:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784938404.422108:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ef3ed 00000020:00000080:2.0:1784938404.430106:0:17157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938404.436774:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x26783cd1c59ef3f4 00000020:00000080:1.0:1784938404.440439:0:17157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784938404.440453:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938404.440464:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938404.440466:0:17157:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784938404.440470:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784938404.440473:0:17157:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1784938404.440474:0:17157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938404.440476:0:17157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938404.440477:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784938404.440480:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938404.440482:0:17157:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784938404.440484:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938404.440488:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938404.440490:0:17157:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784938404.440493:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784938404.440563:0:17157:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784938404.440579:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938404.440582:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938404.440584:0:17157:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784938404.440586:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938404.440589:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938404.440591:0:17157:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784938404.440594:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938404.440598:0:17157:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:1.0:1784938404.440636:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938404.440664:0:17157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff910cf2dc3380) 00000020:00000080:1.0:1784938404.440681:0:17157:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1784938404.440689:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938404.440741:0:17157:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784938404.440746:0:17157:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784938404.440752:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ef402 00010000:00080000:1.0:1784938404.440787:0:17157:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910ce6b6c000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1784938404.442499:0:17157:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1784938404.444026:0:17157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938404.444041:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784938404.444079:0:17157:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784938404.444098:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ef409 00000100:00080000:2.0:1784938404.444110:0:17157:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:2.0:1784938404.444121:0:17157:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff910ce6b6c000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938404.444156:0:17157:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cd2072a00 x1871643144273152/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938404.444186:0:17157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1784938404.444343:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938404.444348:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938404.444350:0:17157:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1784938404.444353:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784938404.444356:0:17157:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1784938404.444358:0:17157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938404.444359:0:17157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938404.444361:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784938404.444363:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938404.444365:0:17157:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784938404.444367:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938404.444372:0:17157:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784938404.444375:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938404.444376:0:17157:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784938404.444379:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784938404.444383:0:17157:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:2.0:1784938404.444401:0:17157:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784938404.444411:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938404.444423:0:17157:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff910bc7544d40) 00000020:00000080:2.0:1784938404.444435:0:17157:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1784938404.444440:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784938404.444503:0:17157:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784938404.444509:0:17157:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784938404.444515:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ef417 00010000:00080000:2.0:1784938404.444566:0:17157:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910cc9069000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1784938404.444775:0:17157:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1784938404.445079:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144273152:192.168.203.126@tcp:38:llog_process_th.0 00000100:00100000:2.0:1784938404.447381:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938404.451173:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144273152 00000100:00100000:0.0:1784938404.451193:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144273152 00000100:00100000:0.0:1784938404.451387:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:0.0:1784938404.451397:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1871643144273152:12345-192.168.203.126@tcp:38:llog_process_th.0 00010000:00020000:0.0:1784938404.451421:0:17144:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.126@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784938404.451634:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1871643144273152:12345-192.168.203.126@tcp:38:llog_process_th.0 Request processed in 235us (4259us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784938404.451643:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00080000:0.0:1784938404.452085:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910ce6b6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784938404.452101:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:0.0:1784938404.452105:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144273152:192.168.203.126@tcp:38:llog_process_th.0 00000040:01000000:3.0:1784938404.453048:0:17157:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784938404.454134:0:17157:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784938404.463396:0:17157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938404.463674:0:17157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1784938404.473726:0:17157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1784938404.479035:0:17163:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784938404.479043:0:17163:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784938404.480178:0:17157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938404.480194:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784938404.480300:0:17157:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784938404.480322:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ef41e 00000100:00080000:0.0:1784938404.480333:0:17157:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:0.0:1784938404.480344:0:17157:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff910cc9069000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938404.480388:0:17157:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfce00 x1871643144273280/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938404.480450:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144273280:192.168.203.126@tcp:8:llog_process_th.0 00000400:00000100:2.0:1784938404.480743:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144273280 offset 0 length 520: 4 00000100:00080000:0.0:1784938404.482057:0:17157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784938404.482166:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938404.482174:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.482176:0:17157:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784938404.482180:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784938404.482183:0:17157:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1784938404.482185:0:17157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938404.482186:0:17157:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938404.482188:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784938404.482191:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.482192:0:17157:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784938404.482195:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784938404.482200:0:17157:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784938404.482204:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.482205:0:17157:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784938404.482209:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938404.482229:0:17157:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1784938404.482252:0:17157:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784938404.482255:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938404.482271:0:17157:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff910cfd7619c0) 00000020:00000080:0.0:1784938404.482287:0:17157:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1784938404.482292:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938404.482370:0:17157:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784938404.482377:0:17157:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784938404.482383:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x26783cd1c59ef42c 00010000:00080000:0.0:1784938404.482417:0:17157:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910cc487f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1784938404.484092:0:17157:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1784938404.484170:0:17157:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784938404.484186:0:17157:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784938404.487832:0:17157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938404.488107:0:17157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1784938404.488295:0:17157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1784938404.488759:0:17165:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784938404.488765:0:17165:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784938404.489469:0:17157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938404.489480:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784938404.489515:0:17157:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784938404.489705:0:17157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ef433 00000100:00080000:2.0:1784938404.489719:0:17157:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:2.0:1784938404.489730:0:17157:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910cc487f000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938404.489767:0:17157:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cd2073100 x1871643144273408/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938404.489833:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144273408:192.168.203.126@tcp:8:llog_process_th.0 00000100:00080000:2.0:1784938404.489981:0:17157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784938404.490047:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938404.490052:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938404.490053:0:17157:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784938404.490056:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938404.490060:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938404.490062:0:17157:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938404.490074:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938404.490076:0:17157:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784938404.490079:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938404.490081:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938404.490082:0:17157:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784938404.490084:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938404.490087:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938404.490088:0:17157:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784938404.490092:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784938404.490119:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17157:1871643144273536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938404.490178:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938404.490202:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019c0840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938404.490802:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144273536 00000100:00100000:1.0:1784938404.490810:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144273536 00000100:00100000:1.0:1784938404.490860:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784938404.490869:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+9:17157:x1871643144273536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938404.491011:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+9:17157:x1871643144273536:12345-0@lo:502:llog_process_th.0 Request processed in 143us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938404.491019:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784938404.491074:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17157:1871643144273536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938404.491100:0:17157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938404.491105:0:17157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938404.491107:0:17157:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784938404.491111:0:17157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1784938404.491165:0:17118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1784938404.491185:0:17118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784938404.491200:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215ba00/0x26783cd1c59ef3a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef3ae expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.491211:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d0215ba00/0x26783cd1c59ef3a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef3ae expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938404.491257:0:17118:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cc871e000 from 1 10000000:01000000:1.0:1784938404.491260:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938404.491287:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.491295:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.491303:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938404.491316:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144273664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938404.491355:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.491376:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4df00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938404.491837:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144273664 00000100:00100000:2.0:1784938404.491844:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144273664 00000100:00100000:2.0:1784938404.491877:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784938404.491884:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+9:17118:x1871643144273664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938404.491893:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938404.491905:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef43a expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.491936:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef43a expref: 10 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.491948:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef43a expref: 10 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.491957:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1000, rc 0) 00000100:00100000:2.0:1784938404.491997:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+10:17118:x1871643144273664:12345-0@lo:101:mount.lustre.0 Request processed in 114us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.492003:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784938404.492145:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144273664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938404.492159:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.492168:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938404.492826:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144273792:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784938404.492866:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.492894:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4df00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938404.492952:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144273792 00000100:00100000:2.0:1784938404.492957:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144273792 00000100:00100000:2.0:1784938404.492987:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784938404.492995:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+10:17118:x1871643144273792:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784938404.493010:0:17134:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784938404.493016:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784938404.493089:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+10:17118:x1871643144273792:12345-0@lo:256:mount.lustre.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.493096:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784938404.493253:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144273792:0@lo:256:mount.lustre.0 00000400:00000100:0.0:1784938404.494485:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144273408 offset 0 length 520: 4 10000000:01000000:1.0:1784938404.494595:0:17118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938404.494620:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.494631:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938404.494639:0:17118:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cc871e000 from 1 10000000:01000000:1.0:1784938404.494642:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938404.494670:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.494678:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.494687:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938404.494703:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144273920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938404.494742:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.494767:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4df00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938404.494785:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144273920 00000100:00100000:1.0:1784938404.494790:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144273920 00000100:00100000:1.0:1784938404.494824:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784938404.494831:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+10:17118:x1871643144273920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938404.494843:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938404.494857:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef448 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.494875:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef448 expref: 11 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.494896:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef448 expref: 11 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.494904:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215a000, rc 0) 00000100:00100000:1.0:1784938404.495007:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17118:x1871643144273920:12345-0@lo:101:mount.lustre.0 Request processed in 175us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938404.495015:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784938404.495057:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144273920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938404.495070:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.495079:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938404.495132:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938404.495156:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938404.495170:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4df00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938404.495853:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144274048 00000100:00100000:2.0:1784938404.495860:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144274048 00000100:00100000:2.0:1784938404.495895:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784938404.495903:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17118:x1871643144274048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938404.496245:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17118:x1871643144274048:12345-0@lo:501:mount.lustre.0 Request processed in 343us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.496253:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784938404.497679:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938404.497737:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938404.497803:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938404.497840:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938404.497947:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144274176 00000100:00100000:1.0:1784938404.497953:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144274176 00000100:00100000:1.0:1784938404.498003:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784938404.498013:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17118:x1871643144274176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938404.498112:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17118:x1871643144274176:12345-0@lo:503:mount.lustre.0 Request processed in 101us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938404.498120:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784938404.498304:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938404.498979:0:17167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17167:1871643144274304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938404.499025:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938404.499059:0:17167:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938404.499160:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144274304 00000100:00100000:3.0:1784938404.499165:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144274304 00000100:00100000:3.0:1784938404.499197:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784938404.499203:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17167:x1871643144274304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938404.499683:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17167:x1871643144274304:12345-0@lo:502:llog_process_th.0 Request processed in 479us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938404.499690:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784938404.501324:0:17167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17167:1871643144274304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938404.501364:0:17167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938404.501377:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.501379:0:17167:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784938404.501386:0:17167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cc871e000 00000020:00000080:0.0:1784938404.501388:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938404.501397:0:17167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938404.501400:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.501401:0:17167:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784938404.501403:0:17167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938404.501405:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.501406:0:17167:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784938404.501409:0:17167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cc871e000 00000020:00000080:0.0:1784938404.501411:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938404.501470:0:17167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938404.501473:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.501474:0:17167:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784938404.501477:0:17167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938404.501479:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.501480:0:17167:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784938404.501484:0:17167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cc871e000 00000020:00000080:0.0:1784938404.501485:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938404.501516:0:17167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938404.501519:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.501520:0:17167:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784938404.501523:0:17167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938404.501525:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.501527:0:17167:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784938404.501530:0:17167:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cc871e000 00000020:00000080:0.0:1784938404.501586:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784938404.501631:0:17167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17167:1871643144274432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938404.501685:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938404.503724:0:17167:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938404.518329:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144274432 00000100:00100000:3.0:1784938404.518343:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144274432 00000100:00100000:3.0:1784938404.518407:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784938404.518417:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17167:x1871643144274432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938404.518595:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17167:x1871643144274432:12345-0@lo:502:llog_process_th.0 Request processed in 179us (16909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938404.518604:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784938404.519603:0:17167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17167:1871643144274432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938404.519642:0:17167:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938404.519651:0:17167:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938404.519654:0:17167:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784938404.519658:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784938404.525526:0:17118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784938404.525572:0:17118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938404.525599:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938404.525612:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938404.525691:0:17118:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784938404.525695:0:17118:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910cc871e000 10000000:01000000:3.0:1784938404.525698:0:17118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910cc871e000 10000000:01000000:3.0:1784938404.525702:0:17118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938404.525708:0:17118:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cc871e000 from 1 10000000:01000000:3.0:1784938404.525711:0:17118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938404.525750:0:17118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d0400/0x26783cd1c59ef456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938404.525759:0:17118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cc97d0400/0x26783cd1c59ef456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938404.525770:0:17118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cc97d0400/0x26783cd1c59ef456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938404.525795:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938404.525865:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938404.525912:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc1778d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938404.526136:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144274560 00000100:00100000:1.0:1784938404.526144:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144274560 00000100:00100000:1.0:1784938404.526194:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784938404.526202:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17118:x1871643144274560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938404.526244:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938404.526259:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d0215b600/0x26783cd1c59ef45d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef456 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.526282:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d0215b600/0x26783cd1c59ef45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef456 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.526293:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d0215b600/0x26783cd1c59ef45d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef456 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938404.526302:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215b600, rc 0) 00000100:00100000:1.0:1784938404.526345:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17118:x1871643144274560:12345-0@lo:101:mount.lustre.0 Request processed in 143us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938404.526351:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784938404.529562:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938404.529593:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cc97d0400/0x26783cd1c59ef456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef45d expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938404.529607:0:17118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cc97d0400/0x26783cd1c59ef456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef45d expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938404.529688:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938404.529748:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938404.529778:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938404.533189:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144274688 00000100:00100000:3.0:1784938404.533202:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144274688 00000100:00100000:3.0:1784938404.533282:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784938404.533292:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17118:x1871643144274688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938404.533468:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17118:x1871643144274688:12345-0@lo:501:mount.lustre.0 Request processed in 177us (3719us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938404.533476:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784938404.536377:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938404.536450:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938404.536529:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938404.536564:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019c0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938404.538074:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144274816 00000100:00100000:3.0:1784938404.538086:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144274816 00000100:00100000:3.0:1784938404.538147:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784938404.538170:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17118:x1871643144274816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938404.538343:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17118:x1871643144274816:12345-0@lo:503:mount.lustre.0 Request processed in 175us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938404.538352:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784938404.538382:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144274816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938404.540149:0:17172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17172:1871643144274944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938404.540542:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938404.540591:0:17172:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019c0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938404.540615:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144274944 00000100:00100000:3.0:1784938404.540621:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144274944 00000100:00100000:3.0:1784938404.540667:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784938404.540675:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17172:x1871643144274944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938404.540795:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17172:x1871643144274944:12345-0@lo:502:llog_process_th.0 Request processed in 120us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938404.540803:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784938404.541683:0:17172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17172:1871643144274944:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784938404.541758:0:17172:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784938404.541774:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff910bc75419c0) 00000020:00000080:2.0:1784938404.541791:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1784938404.541969:0:17172:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cc871e000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784938404.541973:0:17172:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cc871e000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784938404.541976:0:17172:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cc871e000 4 00010000:00080000:2.0:1784938404.542004:0:17172:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910cc5885000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1784938404.549323:0:17172:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1784938404.549445:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784938404.549486:0:17172:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784938404.549500:0:17172:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x26783cd1c59ef46b 00000100:00080000:2.0:1784938404.549511:0:17172:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:2.0:1784938404.549522:0:17172:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff910cc5885000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938404.549558:0:17172:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cd2070380 x1871643144275072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938404.549586:0:17172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784938404.550793:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144275072:192.168.203.126@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938404.551714:0:17172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17172:1871643144275200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938404.551784:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938404.551822:0:17172:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938404.551866:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144275200 00000100:00100000:3.0:1784938404.551874:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144275200 00000100:00100000:3.0:1784938404.551935:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784938404.551945:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17172:x1871643144275200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938404.552069:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17172:x1871643144275200:12345-0@lo:502:llog_process_th.0 Request processed in 125us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938404.552077:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784938404.552252:0:17172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17172:1871643144275200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938404.552297:0:17172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17172:1871643144275328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938404.552333:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938404.552352:0:17172:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938404.552402:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144275328 00000100:00100000:3.0:1784938404.552406:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144275328 00000100:00100000:3.0:1784938404.552436:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784938404.552443:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17172:x1871643144275328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938404.552506:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17172:x1871643144275328:12345-0@lo:502:llog_process_th.0 Request processed in 62us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938404.552521:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784938404.552664:0:17172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17172:1871643144275328:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784938404.552687:0:17172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784938404.552747:0:17118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784938404.552770:0:17118:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938404.552791:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d0400/0x26783cd1c59ef456 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef45d expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938404.552801:0:17118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cc97d0400/0x26783cd1c59ef456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef45d expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784938404.552849:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784938404.552851:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938404.552852:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938404.552853:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938404.552854:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938404.552856:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938404.552857:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938404.552858:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938404.552861:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938404.552862:0:17118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938404.552865:0:17118:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784938404.552868:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938404.552870:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938404.552871:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938404.552872:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938404.552873:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938404.552874:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938404.552881:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938404.552882:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938404.552883:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938404.552884:0:17118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938404.552897:0:17118:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784938404.552905:0:17118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144275456:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784938404.552948:0:17118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938404.552961:0:17118:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7382900 going to sleep for 11 seconds 00000100:00100000:0.0:1784938404.552976:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144275456 00000100:00100000:0.0:1784938404.552980:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144275456 00000100:00100000:0.0:1784938404.553004:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938404.553010:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17118:x1871643144275456:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784938404.553033:0:17134:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784938404.553046:0:17134:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784938404.553463:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938404.553498:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144275072 00000100:00100000:2.0:1784938404.553503:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144275072 00000100:00100000:2.0:1784938404.553531:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:2.0:1784938404.553537:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1871643144275072:12345-192.168.203.126@tcp:38:llog_process_th.0 00000100:00100000:2.0:1784938404.553592:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1871643144275072:12345-192.168.203.126@tcp:38:llog_process_th.0 Request processed in 53us (131us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784938404.553598:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 20000000:01000000:3.0:1784938404.560054:0:17134:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784938404.560075:0:17134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784938404.560340:0:17155:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784938404.560345:0:17155:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784938404.560368:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938404.560386:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef43a expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938404.560395:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938404.560433:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef43a expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938404.560447:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef43a expref: 12 pid: 17134 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938404.560461:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144275584:0@lo:104: 00000100:00100000:1.0:1784938404.562948:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938404.562962:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc5885000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938404.562972:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.126@tcp failed (-11) 00000100:00100000:1.0:1784938404.562976:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144275072:192.168.203.126@tcp:38:llog_process_th.0 00000100:00100000:3.0:1784938404.563113:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17118:x1871643144275456:12345-0@lo:253:mount.lustre.0 Request processed in 10099us (10161us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938404.563125:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938404.563637:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938404.563718:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc73829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938404.563744:0:17118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17118:1871643144275456:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784938404.563758:0:17118:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784938404.563761:0:17118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938404.563763:0:17118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784938404.563764:0:17118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938404.563765:0:17118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938404.563766:0:17118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938404.563767:0:17118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938404.563769:0:17118:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784938404.563778:0:17118:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784938404.563780:0:17118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938404.563782:0:17118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784938404.563793:0:17118:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1784938404.565815:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144275584 00000100:00100000:2.0:1784938404.565829:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144275584 00000100:00100000:2.0:1784938404.565954:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938404.566065:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:17155:x1871643144275584:12345-0@lo:104: 00010000:00010000:2.0:1784938404.566086:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.566179:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938404.566186:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:17155:x1871643144275584:12345-0@lo:104: Request processed in 214us (2550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.566194:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938404.566382:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144275584:0@lo:104: 00010000:00010000:2.0:1784938404.566405:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.566423:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938404.566429:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.566436:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938404.566441:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.566449:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938404.566457:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938404.566464:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938404.566501:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.566518:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938404.566539:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.566546:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef43a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef441 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.566564:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938404.566566:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938404.566568:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938404.566607:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144275712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938404.566644:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938404.566756:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144275712 00000100:00100000:2.0:1784938404.566761:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144275712 00010000:00010000:2.0:1784938404.566780:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef43a expref: 12 pid: 17134 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938404.566804:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938404.566812:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:3640:x1871643144275712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938404.566832:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938404.566839:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef43a expref: 12 pid: 17134 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.566850:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef43a expref: 12 pid: 17134 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.566866:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef43a expref: 12 pid: 17134 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567101:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567111:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938404.567127:0:17124:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006782271s 00010000:00010000:2.0:1784938404.567132:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567139:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567146:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567153:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567160:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77400 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938404.567165:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567174:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567190:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567200:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938404.567382:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:3640:x1871643144275712:12345-0@lo:103:ldlm_bl.0 Request processed in 570us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938404.567390:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784938404.567431:0:17155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567440:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938404.567446:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77400/0x26783cd1c59ef472 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938404.567477:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144275712:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1784938404.596087:0:17118:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1784938404.597256:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784938404.597266:0:17178:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1784938404.597270:0:17178:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1784938404.597729:0:17179:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784938404.598163:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1784938404.598208:0:17179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938404.603616:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784938404.603700:0:17179:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1784938404.605474:0:17180:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff910cffbffb80 x1871643144275840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938404.605488:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00000040:01000000:2.0:1784938404.606719:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784938404.606762:0:17118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784938404.609191:0:17118:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784938404.609234:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784938404.609647:0:17118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938404.612778:0:17118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784938404.613889:0:17118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784938404.613975:0:17118:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1784938404.615437:0:17118:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1784938404.617500:0:17118:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1784938404.620692:0:17118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1784938404.622466:0:17118:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1784938404.622514:0:17118:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7d5418a7988 00100000:10000000:2.0:1784938404.622521:0:17118:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1784938404.623556:0:17118:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784938404.623572:0:17118:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784938404.623593:0:17118:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1784938404.623609:0:17118:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1784938404.624495:0:17118:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938404.624686:0:17118:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784938405.087427:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938405.600130:0:17173:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938405.600139:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 10000000:01000000:0.0:1784938405.601200:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938405.601206:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cc871e000 from 7 10000000:01000000:0.0:1784938405.601210:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938405.601279:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938405.601293:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938405.601305:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938405.601331:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144275968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938405.601402:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938405.601477:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1587180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938405.601676:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144275968 00000100:00100000:1.0:1784938405.601683:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144275968 00000100:00100000:1.0:1784938405.601736:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784938405.601746:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+11:17136:x1871643144275968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938405.601759:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938405.601773:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef479 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938405.601795:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef479 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938405.601805:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef479 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938405.601814:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215ae00, rc 0) 00000100:00100000:1.0:1784938405.602045:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17136:x1871643144275968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 299us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938405.602053:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000040:00080000:0.0:1784938405.602327:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1784938405.602336:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938405.605339:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144275968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938405.605370:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938405.605383:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938405.605498:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144276096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784938405.605563:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938405.605605:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cecf1a480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938405.605942:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144276096 00000100:00100000:3.0:1784938405.605949:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144276096 00000100:00100000:3.0:1784938405.605997:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784938405.606005:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17136:x1871643144276096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784938405.606026:0:17134:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784938405.606042:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784938405.606045:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1784938405.606140:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17136:x1871643144276096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938405.606147:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784938405.606416:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144276096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784938405.606472:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784938405.606481:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938405.606490:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938405.664120:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:0.0:1784938406.111431:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938406.625457:0:17173:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938406.625471:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938406.625630:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1784938406.625678:0:17173:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938406.625826:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:0.0:1784938406.687366:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:3.0:1784938407.135413:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938407.711953:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938408.160791:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938408.735292:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00000001:02000400:1.0:1784938408.995068:0:17423:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784938409.186364:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938409.632933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784938409.632940:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784938409.632944:0:36:0:(import.c:65:import_set_state_nolock()) ffff910ce6b6c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938409.632954:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.203.126@tcp last attempt 472 00000100:00080000:3.0:1784938409.632965:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938409.632973:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff910ce6b6c000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938409.632997:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb27100 x1871643144276352/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938409.633037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938409.633041:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784938409.633044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938409.633047:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784938409.633049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784938409.633052:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784938409.633054:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cc5885000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938409.633059:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff910cc5885000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938409.633073:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb26d80 x1871643144276480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938409.633165:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144276352:192.168.203.126@tcp:38:kworker.0 00000100:00100000:0.0:1784938409.633234:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938409.633249:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144276224:0@lo:400:kworker.0 00000100:00100000:1.0:1784938409.633292:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144276480:192.168.203.126@tcp:38:kworker.0 00000100:00100000:0.0:1784938409.633298:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938409.633340:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144276224 00000100:00100000:1.0:1784938409.633347:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144276224 00000100:00100000:1.0:1784938409.633451:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784938409.633462:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:3640:x1871643144276224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938409.633563:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144276224:0@lo:400:kworker.0 00000100:00100000:3.0:1784938409.633783:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938409.633853:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938409.633881:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144276352 00000100:00100000:3.0:1784938409.633885:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144276352 00000100:00100000:3.0:1784938409.633920:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:3.0:1784938409.633925:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1871643144276352:12345-192.168.203.126@tcp:38:kworker.0 00010000:00020000:3.0:1784938409.633942:0:17144:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.126@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784938409.634250:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:3640:x1871643144276224:12345-0@lo:400:kworker.0 Request processed in 787us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938409.634259:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784938409.634501:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144276480 00000100:00100000:0.0:1784938409.634523:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144276480 00000100:00100000:0.0:1784938409.634553:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:0.0:1784938409.634559:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1871643144276480:12345-192.168.203.126@tcp:38:kworker.0 00010000:00080000:0.0:1784938409.634578:0:17141:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:0.0:1784938409.634616:0:17141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x26783cd1c59ef487 00000004:00100000:0.0:1784938409.634628:0:17141:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784938409.634754:0:17141:0:(import.c:65:import_set_state_nolock()) ffff910bc6751000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938409.634806:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1871643144276480:12345-192.168.203.126@tcp:38:kworker.0 Request processed in 246us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938409.634813:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00010000:00080000:1.0:1784938409.635792:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910cffb26d80 x1871643144276480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938409.635884:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784938409.635926:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784938409.635932:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784938409.635935:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc5885000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784938409.635942:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1871643144276480:192.168.203.126@tcp:38:kworker.0 00000100:00100000:2.0:1784938409.660323:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1871643144276352:12345-192.168.203.126@tcp:38:kworker.0 Request processed in 26384us (26529us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938409.660343:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00080000:1.0:1784938409.661278:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910ce6b6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938409.661286:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:1.0:1784938409.661292:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144276352:192.168.203.126@tcp:38:kworker.0 00000100:00100000:0.0:1784938409.759499:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00000020:00000004:1.0:1784938409.859206:0:17475:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938409.859692:0:17475:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784938410.208991:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784938410.740448:0:17525:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938410.740637:0:17525:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784938410.788276:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938411.240169:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938411.814864:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938412.255486:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938412.831342:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938413.283008:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938413.862389:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938414.304831:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938414.753529:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784938414.753539:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784938414.753543:0:36:0:(import.c:65:import_set_state_nolock()) ffff910ce6b6c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938414.753556:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.203.126@tcp last attempt 477 00000100:00080000:0.0:1784938414.753569:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784938414.753577:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff910ce6b6c000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938414.753603:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbff480 x1871643144276736/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938414.753616:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938414.753631:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784938414.753634:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938414.753638:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784938414.753751:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144276608:0@lo:400:kworker.0 00000100:00100000:3.0:1784938414.753868:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938414.753931:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938414.753946:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144276864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938414.754059:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938404/real 1784938404] req@ffff910cd2073100 x1871643144273408/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938414 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938414.754205:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910cd2073100 x1871643144273408/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938414 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938414.754360:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938404/real 1784938404] req@ffff910cffbfce00 x1871643144273280/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938414 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938414.754376:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910cffbfce00 x1871643144273280/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938414 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938414.754388:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144276736:192.168.203.126@tcp:38:kworker.0 00000100:00080000:1.0:1784938414.754443:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938414.754460:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:1.0:1784938414.754465:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144273408:192.168.203.126@tcp:8:llog_process_th.0 00000100:00080000:1.0:1784938414.754470:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc9069000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938414.754474:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:1.0:1784938414.754477:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144273280:192.168.203.126@tcp:8:llog_process_th.0 00000100:00100000:0.0:1784938414.754846:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144276608 00000100:00100000:0.0:1784938414.754873:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144276608 00000100:00100000:0.0:1784938414.754942:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938414.754953:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:3642:x1871643144276608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938414.755883:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:3642:x1871643144276608:12345-0@lo:400:kworker.0 Request processed in 923us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938414.755898:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784938414.756445:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144276608:0@lo:400:kworker.0 00000100:00100000:3.0:1784938414.756797:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938414.756869:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144276864 00000100:00100000:3.0:1784938414.756878:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144276864 00000100:00100000:3.0:1784938414.756929:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:3.0:1784938414.756939:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144276864:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938414.757024:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144276864:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938414.757033:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00080000:1.0:1784938414.757422:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938414.757428:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784938414.757432:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cc9069000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938414.757439:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 472 00000100:00080000:1.0:1784938414.757448:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784938414.757453:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff910cc9069000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:1.0:1784938414.757497:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc678fb80 x1871643144276992/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938414.757542:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938414.757547:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784938414.757549:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938414.757553:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 472 00000100:00080000:1.0:1784938414.757557:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784938414.757562:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910cc487f000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:1.0:1784938414.757577:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc678ed80 x1871643144277120/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938414.757610:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144276992:192.168.203.126@tcp:8:kworker.0 00000100:00100000:1.0:1784938414.757684:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144277120:192.168.203.126@tcp:8:kworker.0 00010000:00080000:1.0:1784938414.765262:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910cffbfdf80 x1871643144276864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938414.765290:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144276864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938414.766472:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000400:00000100:3.0:1784938414.767800:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144276992 offset 0 length 520: 4 00000400:00000100:3.0:1784938414.767814:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144277120 offset 0 length 520: 4 00000100:00100000:1.0:1784938414.769080:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144276736 00000100:00100000:1.0:1784938414.769103:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144276736 00000100:00100000:1.0:1784938414.769184:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:1.0:1784938414.769196:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1871643144276736:12345-192.168.203.126@tcp:38:kworker.0 00010000:00020000:1.0:1784938414.769248:0:17145:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.203.126@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784938414.781444:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1871643144276736:12345-192.168.203.126@tcp:38:kworker.0 Request processed in 12233us (14969us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784938414.781463:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00080000:1.0:1784938414.781802:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910ce6b6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938414.781818:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:1.0:1784938414.781823:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144276736:192.168.203.126@tcp:38:kworker.0 00000100:00100000:1.0:1784938414.881674:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938415.329181:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938415.906629:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938416.354636:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784938416.869123:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784938416.937453:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938417.375380:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784938417.392550:0:17870:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:0.0:1784938417.392555:0:17870:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784938417.392556:0:17870:0:(obd_mount.c:925:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784938417.392677:0:17870:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff910bc7112800 00000020:01000004:0.0:1784938417.392692:0:17870:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1784938417.392704:0:17870:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784938417.392717:0:17870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff910cfd764d40) 00000020:00000080:0.0:1784938417.392734:0:17870:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784938417.462589:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784938417.462921:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1784938417.468040:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784938417.475029:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1784938417.477051:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784938417.477642:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1784938417.478155:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784938417.478721:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784938417.480169:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784938417.480754:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1784938417.481260:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784938417.481554:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784938417.481825:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784938417.482130:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1784938417.483132:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.483357:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.484360:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.484730:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.489282:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.489697:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.489946:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.491151:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.491538:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.491745:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.492091:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.492354:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.492695:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.492913:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.493678:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.494313:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.494533:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.494937:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.495764:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.496071:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.496335:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.496730:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.496937:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.497124:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.497338:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.497580:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.497920:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.498150:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.498447:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.498798:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1784938417.499075:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1784938417.499298:0:17870:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00080000:01000000:0.0:1784938417.500737:0:17870:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784938417.501659:0:17870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1784938417.501682:0:17870:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784938417.501696:0:17870:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59ef495 00000020:01000004:0.0:1784938417.501704:0:17870:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784938417.501730:0:17870:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784938417.501734:0:17870:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784938417.501740:0:17870:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1784938417.501767:0:17870:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1784938417.501772:0:17870:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1784938417.509754:0:17870:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784938417.509796:0:17870:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1784938417.509800:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784938417.509802:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784938417.509803:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938417.509805:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938417.509806:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938417.509807:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938417.509809:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938417.509811:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938417.509812:0:17870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938417.509815:0:17870:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1784938417.509818:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938417.509819:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784938417.509821:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938417.509822:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938417.509823:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938417.509824:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938417.509825:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938417.509826:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938417.509827:0:17870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938417.510058:0:17870:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784938417.510080:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277248:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784938417.510162:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938417.510288:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cecf1af00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938417.512755:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144277248 00000100:00100000:1.0:1784938417.512769:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144277248 00000100:00100000:1.0:1784938417.512953:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784938417.512964:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17870:x1871643144277248:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784938417.513002:0:17131:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784938417.513005:0:17131:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1784938417.513013:0:17131:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1784938417.513659:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17870:x1871643144277248:12345-0@lo:253:mount.lustre.0 Request processed in 694us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.513669:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784938417.513775:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784938417.513790:0:17870:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1784938417.513793:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938417.513794:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784938417.513796:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938417.513797:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938417.513798:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938417.513799:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938417.513800:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938417.513802:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938417.513803:0:17870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784938417.513822:0:17870:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910bc7112800 from lustre-MDT0001 10000000:01000000:3.0:1784938417.513876:0:17870:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1784938417.513879:0:17870:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1784938417.513886:0:17870:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910bc715b380 local copy 00010000:00010000:3.0:1784938417.513896:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938417.514024:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938417.514061:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938417.514113:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7448f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938417.514358:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144277376 00000100:00100000:0.0:1784938417.514364:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144277376 00000100:00100000:0.0:1784938417.514411:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938417.514418:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17870:x1871643144277376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938417.514486:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17870:x1871643144277376:12345-0@lo:501:mount.lustre.0 Request processed in 69us (425us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938417.514493:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784938417.514576:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277376:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784938417.514590:0:17870:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784938417.514612:0:17870:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784938417.514625:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.514633:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938417.514660:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910bc7112800 10000000:01000000:2.0:1784938417.514665:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784938417.514670:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff910bc715b380 10000000:01000000:2.0:1784938417.514673:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1784938417.514675:0:17870:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff910bc715b380 from 1 10000000:01000000:2.0:1784938417.514678:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784938417.514705:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1600/0x26783cd1c59ef49c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.514712:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc1600/0x26783cd1c59ef49c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.514720:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc1600/0x26783cd1c59ef49c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938417.514733:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938417.514760:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.514790:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291b180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938417.514857:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144277504 00000100:00100000:3.0:1784938417.514861:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144277504 00000100:00100000:3.0:1784938417.514883:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784938417.514889:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+12:17870:x1871643144277504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938417.514897:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938417.514911:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc97d1800/0x26783cd1c59ef4a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef49c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.514930:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d1800/0x26783cd1c59ef4a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef49c expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.514939:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc97d1800/0x26783cd1c59ef4a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef49c expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.514948:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1800, rc 0) 00000100:00100000:3.0:1784938417.515142:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+13:17870:x1871643144277504:12345-0@lo:101:mount.lustre.0 Request processed in 252us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.515149:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784938417.518109:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938417.518140:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc1600/0x26783cd1c59ef49c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef4a3 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.518153:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1600/0x26783cd1c59ef49c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef4a3 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938417.518193:0:17870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784938417.518329:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1600/0x26783cd1c59ef49c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef4a3 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.518337:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc1600/0x26783cd1c59ef49c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef4a3 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938417.518348:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff910bc7112800 10000000:01000000:2.0:1784938417.518353:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784938417.518358:0:17870:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff910bc7112800 from 1 10000000:01000000:2.0:1784938417.518361:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784938417.518391:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1a00/0x26783cd1c59ef4aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.518399:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc1a00/0x26783cd1c59ef4aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.518408:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc1a00/0x26783cd1c59ef4aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938417.518428:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938417.518488:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.518528:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938417.519744:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144277632 00000100:00100000:0.0:1784938417.519758:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144277632 00000100:00100000:0.0:1784938417.519816:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938417.519827:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+13:17870:x1871643144277632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938417.519857:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938417.519874:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77000/0x26783cd1c59ef4b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef4aa expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.519900:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77000/0x26783cd1c59ef4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef4aa expref: 14 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.519910:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77000/0x26783cd1c59ef4b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef4aa expref: 14 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.519918:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77000, rc 0) 00000100:00100000:0.0:1784938417.520125:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+14:17870:x1871643144277632:12345-0@lo:101:mount.lustre.0 Request processed in 300us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938417.520132:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784938417.520271:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938417.520290:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc1a00/0x26783cd1c59ef4aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef4b1 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.520299:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1a00/0x26783cd1c59ef4aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef4b1 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938417.520329:0:17870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784938417.520739:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1a00/0x26783cd1c59ef4aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef4b1 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.520749:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc1a00/0x26783cd1c59ef4aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef4b1 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938417.520758:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784938417.520762:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784938417.520768:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff910bc7112800 10000000:01000000:2.0:1784938417.520771:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784938417.520775:0:17870:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1784938417.520777:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784938417.520805:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc0800/0x26783cd1c59ef4b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.520812:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc0800/0x26783cd1c59ef4b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.520820:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc0800/0x26783cd1c59ef4b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938417.520837:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938417.520891:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.520962:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291b180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938417.521155:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144277760 00000100:00100000:1.0:1784938417.521161:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144277760 00000100:00100000:1.0:1784938417.521304:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784938417.521313:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+14:17870:x1871643144277760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938417.521323:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938417.521335:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d0215be00/0x26783cd1c59ef4bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef4b8 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.521352:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d0215be00/0x26783cd1c59ef4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef4b8 expref: 15 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.521361:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d0215be00/0x26783cd1c59ef4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef4b8 expref: 15 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.521379:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d0215be00, rc 0) 00000100:00100000:1.0:1784938417.521459:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+15:17870:x1871643144277760:12345-0@lo:101:mount.lustre.0 Request processed in 148us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.521467:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784938417.521551:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938417.521564:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc0800/0x26783cd1c59ef4b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef4bf expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.521578:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc0800/0x26783cd1c59ef4b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef4bf expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938417.523173:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1784938417.524180:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938417.531777:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1784938417.531834:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1784938417.532396:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1784938417.532414:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1784938417.532426:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1784938417.532440:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1784938417.532455:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1784938417.532468:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1784938417.532480:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1784938417.532493:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1784938417.532505:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1784938417.532517:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1784938417.532528:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1784938417.532542:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1784938417.532555:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1784938417.532567:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1784938417.532577:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1784938417.532588:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1784938417.532601:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1784938417.532675:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1784938417.532694:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1784938417.532709:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1784938417.532722:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1784938417.532746:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1784938417.532752:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1784938417.532937:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938417.533090:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.533187:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291b480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938417.533322:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144277888 00000100:00100000:1.0:1784938417.533329:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144277888 00000100:00100000:1.0:1784938417.533410:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784938417.533420:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+15:17870:x1871643144277888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938417.533555:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+15:17870:x1871643144277888:12345-0@lo:501:mount.lustre.0 Request processed in 136us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.533562:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784938417.533649:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144277888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938417.533682:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144278016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938417.533722:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.535145:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291b480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938417.535773:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144278016 00000100:00100000:0.0:1784938417.535782:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144278016 00000100:00100000:3.0:1784938417.535938:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784938417.535952:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+15:17870:x1871643144278016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938417.537170:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+15:17870:x1871643144278016:12345-0@lo:503:mount.lustre.0 Request processed in 1218us (3443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938417.537258:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144278016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784938417.537729:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938417.537812:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144278144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938417.537881:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.537906:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938417.539953:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144278144 00000100:00100000:0.0:1784938417.539980:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144278144 00000100:00100000:0.0:1784938417.540038:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784938417.540049:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+16:17870:x1871643144278144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938417.540092:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784938417.542427:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+15:17870:x1871643144278144:12345-0@lo:502:mount.lustre.0 Request processed in 2363us (4527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938417.542441:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784938417.542905:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144278144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784938417.543300:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784938417.543331:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1784938417.543345:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1784938417.543358:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1784938417.543369:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1784938417.543381:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1784938417.543393:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1784938417.543404:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1784938417.544607:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1784938417.544632:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1784938417.544648:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1784938417.544662:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1784938417.544675:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1784938417.544705:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1784938417.544721:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1784938417.544736:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1784938417.544753:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1784938417.544768:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1784938417.544781:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1784938417.544793:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1784938417.544804:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1784938417.545643:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1784938417.545695:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1784938417.545723:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1784938417.545741:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1784938417.545761:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1784938417.545793:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1784938417.545813:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1784938417.545827:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1784938417.545852:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1784938417.545867:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1784938417.545880:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1784938417.545893:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1784938417.545907:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1784938417.545920:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1784938417.545933:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1784938417.545946:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1784938417.545960:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1784938417.545973:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1784938417.545985:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1784938417.545997:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1784938417.546009:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1784938417.546021:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1784938417.546036:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1784938417.546097:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144278272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938417.546182:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938417.546404:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7448780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938417.546725:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144278272 00000100:00100000:1.0:1784938417.546732:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144278272 00000100:00100000:1.0:1784938417.546789:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784938417.546798:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+15:17870:x1871643144278272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938417.546947:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+15:17870:x1871643144278272:12345-0@lo:502:mount.lustre.0 Request processed in 150us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.546955:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938417.547081:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144278272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784938417.547145:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1784938417.547157:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1784938417.551572:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938417.551586:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938417.551588:0:17874:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1784938417.551594:0:17874:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1784938417.551597:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938417.551611:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff910bc71599c0) 00000020:00000080:3.0:1784938417.551632:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1784938417.551637:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784938417.551735:0:17874:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784938417.551745:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59ef4cd 00000020:00000080:3.0:1784938417.551996:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1784938417.552007:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938417.552011:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938417.552012:0:17874:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1784938417.552015:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938417.552019:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938417.552021:0:17874:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1784938417.552024:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784938417.552033:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff910cfcfbb380) 00000020:00000080:3.0:1784938417.552044:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1784938417.552048:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784938417.552050:0:17874:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1784938417.552053:0:17874:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1784938417.552058:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784938417.552114:0:17874:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910bc7112800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1784938417.552126:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff910cfcfbcd40) 00000020:00000080:3.0:1784938417.552348:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1784938417.552407:0:17874:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784938417.552425:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ef4e2 00000020:00000080:3.0:1784938417.552527:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1784938417.552534:0:17874:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784938417.552539:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x26783cd1c59ef4e9 00080000:01000000:3.0:1784938417.552545:0:17874:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784938417.552547:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59ef4f0 00010000:00010000:0.0:1784938417.654007:0:17874:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1784938417.655555:0:17874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1784938417.656860:0:17874:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784938417.659542:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1784938417.659556:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938417.659564:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.659566:0:17874:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1784938417.659570:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938417.659575:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.659577:0:17874:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1784938417.659580:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938417.659591:0:17874:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:1.0:1784938417.659618:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938417.659632:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff910cf2dc0000) 00000020:00000080:1.0:1784938417.659665:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1784938417.659674:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938417.659747:0:17874:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1784938417.659758:0:17874:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784938417.659766:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59ef4fe 00010000:00080000:1.0:1784938417.659811:0:17874:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc8417000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1784938417.662317:0:17874:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1784938417.668158:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784938417.668172:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784938417.668209:0:17874:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784938417.669389:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ef505 00000100:00080000:0.0:1784938417.669405:0:17874:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:0.0:1784938417.669418:0:17874:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff910bc8417000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938417.669457:0:17874:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfed80 x1871643144278400/t0(0) o38->lustre-MDT0000-osp-MDT0001@192.168.203.126@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938417.669533:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144278400:192.168.203.126@tcp:38:llog_process_th.0 00000100:00100000:3.0:1784938417.670404:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938417.670436:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144278400 00000100:00100000:3.0:1784938417.670444:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144278400 00000100:00100000:3.0:1784938417.670480:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938417.670488:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1871643144278400:12345-192.168.203.126@tcp:38:llog_process_th.0 00010000:00080000:3.0:1784938417.670525:0:17144:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1784938417.670560:0:17144:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ef50c 00000004:00100000:3.0:1784938417.670572:0:17144:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1784938417.670591:0:17144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1784938417.671680:0:17874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1784938417.671786:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938417.671792:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.671795:0:17874:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1784938417.671798:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784938417.671801:0:17874:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1784938417.671803:0:17874:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938417.671804:0:17874:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938417.671806:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784938417.671809:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.671810:0:17874:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784938417.671813:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938417.671818:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.671819:0:17874:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1784938417.671823:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784938417.671896:0:17874:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784938417.671912:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938417.671915:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.671917:0:17874:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1784938417.671920:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784938417.671922:0:17874:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1784938417.671923:0:17874:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938417.671925:0:17874:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938417.671927:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784938417.671929:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.671931:0:17874:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784938417.671933:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784938417.671936:0:17874:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784938417.671939:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.671941:0:17874:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784938417.671944:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938417.671947:0:17874:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1784938417.671966:0:17874:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784938417.671969:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938417.671984:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff910cfd763380) 00000020:00000080:0.0:1784938417.672001:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1784938417.672007:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938417.672075:0:17874:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1784938417.672082:0:17874:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784938417.672089:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59ef51a 00010000:00080000:0.0:1784938417.672124:0:17874:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910cdfb54000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1784938417.672372:0:17874:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1784938417.674420:0:17874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:1.0:1784938417.674777:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784938417.674782:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784938417.674786:0:38:0:(import.c:65:import_set_state_nolock()) ffff910ce6b6c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938417.674795:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 192.168.203.126@tcp last attempt 482 00000100:00080000:1.0:1784938417.674806:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784938417.674812:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff910ce6b6c000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:1.0:1784938417.674866:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc678c700 x1871643144278528/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938417.675365:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144278528:192.168.203.126@tcp:38:kworker.0 00000100:00100000:2.0:1784938417.675606:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000040:01000000:0.0:1784938417.675623:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1784938417.676169:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938417.676173:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938417.676175:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938417.676178:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784938417.676240:0:17145:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1784938417.676247:0:17145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1784938417.676266:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144278656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938417.676418:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938417.676443:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144278656 00000100:00100000:1.0:1784938417.676443:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144278528 00000100:00100000:3.0:1784938417.676449:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144278656 00000100:00100000:1.0:1784938417.676450:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144278528 00000100:00100000:3.0:1784938417.676480:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:3.0:1784938417.676488:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144278656:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938417.676549:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144278656:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 61us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.676549:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:1.0:1784938417.676554:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1871643144278528:12345-192.168.203.126@tcp:38:kworker.0 00000100:00100000:3.0:1784938417.676556:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:1.0:1784938417.676596:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1871643144278528:12345-192.168.203.126@tcp:38:kworker.0 Request processed in 40us (990us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784938417.676603:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:3.0:1784938417.676718:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938417.676727:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910ce6b6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938417.676732:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.203.126@tcp failed (-11) 00000100:00100000:3.0:1784938417.676736:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144278528:192.168.203.126@tcp:38:kworker.0 00000100:00080000:3.0:1784938417.678481:0:17144:0:(import.c:65:import_set_state_nolock()) ffff910bc7c65000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938417.679471:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1871643144278400:12345-192.168.203.126@tcp:38:llog_process_th.0 Request processed in 8976us (9064us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.679482:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:2.0:1784938417.679931:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938417.679941:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1784938417.679949:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784938417.679955:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784938417.679958:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc8417000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784938417.679970:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144278400:192.168.203.126@tcp:38:llog_process_th.0 00010000:00080000:1.0:1784938417.680015:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910bc678f800 x1871643144278656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938417.680029:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144278656:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938417.680157:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938417.680170:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144278784:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938417.680863:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938417.680893:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144278784 00000100:00100000:3.0:1784938417.680899:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144278784 00000100:00100000:3.0:1784938417.680939:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:3.0:1784938417.680948:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1871643144278784:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938417.680979:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784938417.681023:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1871643144278784:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 75us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.681039:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:3.0:1784938417.681157:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144278784:192.168.203.126@tcp:41:osp-pre-0-1.0 00000040:00080000:0.0:1784938417.684621:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938417.685120:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1784938417.686414:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1784938417.687057:0:17880:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784938417.687063:0:17880:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784938417.688401:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784938417.688416:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784938417.688461:0:17874:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784938417.688484:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ef521 00000100:00080000:0.0:1784938417.688631:0:17874:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:0.0:1784938417.688715:0:17874:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff910cdfb54000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938417.688752:0:17874:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfc380 x1871643144278912/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938417.688822:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144278912:192.168.203.126@tcp:8:llog_process_th.0 00000100:00080000:0.0:1784938417.689042:0:17874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784938417.689107:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938417.689111:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.689113:0:17874:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784938417.689116:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784938417.689118:0:17874:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1784938417.689120:0:17874:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938417.689121:0:17874:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938417.689122:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784938417.689124:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.689125:0:17874:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784938417.689128:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784938417.689131:0:17874:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784938417.689135:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.689136:0:17874:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784938417.689139:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938417.689142:0:17874:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1784938417.689159:0:17874:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784938417.689162:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938417.689178:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff910cecfa4d40) 00000020:00000080:0.0:1784938417.689193:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1784938417.689209:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938417.689324:0:17874:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1784938417.689331:0:17874:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784938417.689348:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x26783cd1c59ef52f 00010000:00080000:0.0:1784938417.689380:0:17874:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910cdf495800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1784938417.689600:0:17874:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1784938417.689687:0:17874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784938417.689701:0:17874:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1784938417.690349:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938417.690355:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938417.690358:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938417.690361:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1784938417.692351:0:17874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938417.692779:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1784938417.692965:0:17874:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000400:00000100:3.0:1784938417.694171:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144278912 offset 0 length 520: 4 00000040:00080000:3.0:1784938417.694734:0:17882:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784938417.694739:0:17882:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784938417.696776:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784938417.696791:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784938417.696835:0:17874:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784938417.696921:0:17874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ef536 00000100:00080000:0.0:1784938417.696933:0:17874:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:0.0:1784938417.696944:0:17874:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff910cdf495800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938417.696979:0:17874:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfca80 x1871643144279040/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938417.696997:0:17874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784938417.697167:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938417.697172:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.697174:0:17874:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784938417.697177:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938417.697180:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.697181:0:17874:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938417.697184:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938417.697185:0:17874:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784938417.697188:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938417.697190:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.697192:0:17874:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784938417.697208:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938417.697211:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.697246:0:17874:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784938417.697252:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784938417.697281:0:17874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938417.697285:0:17874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938417.697286:0:17874:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784938417.697289:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1784938417.697347:0:17870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1784938417.697386:0:17870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784938417.697401:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc0800/0x26783cd1c59ef4b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef4bf expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.697413:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc0800/0x26783cd1c59ef4b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef4bf expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938417.697422:0:17870:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910bc7112800 from 1 10000000:01000000:0.0:1784938417.697425:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938417.697452:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.697461:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.697471:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938417.697491:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938417.697625:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938417.697668:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938417.697687:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144279168 00000100:00100000:0.0:1784938417.697700:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144279168 00000100:00100000:1.0:1784938417.698035:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144279040:192.168.203.126@tcp:8:llog_process_th.0 00000400:00000100:3.0:1784938417.698371:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144279040 offset 0 length 520: 4 00000100:00080000:2.0:1784938417.698581:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938417.698588:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938417.698590:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938417.698593:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938417.698756:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784938417.698768:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+15:17870:x1871643144279168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938417.698785:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938417.698801:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef53d expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.698828:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef53d expref: 16 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.698919:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef53d expref: 16 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.698930:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76400, rc 0) 00000100:00100000:0.0:1784938417.698988:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+16:17870:x1871643144279168:12345-0@lo:101:mount.lustre.0 Request processed in 223us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938417.698995:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784938417.699153:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938417.699170:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.699180:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938417.700963:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279296:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784938417.701027:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938417.701103:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938417.701146:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144279296 00000100:00100000:3.0:1784938417.701153:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144279296 00000100:00100000:3.0:1784938417.701336:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784938417.701347:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+16:17870:x1871643144279296:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784938417.701366:0:17131:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784938417.701385:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784938417.701388:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1784938417.701480:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+16:17870:x1871643144279296:12345-0@lo:256:mount.lustre.0 Request processed in 135us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.701488:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784938417.701576:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279296:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784938417.702177:0:17870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938417.702203:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.702478:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938417.702549:0:17870:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910bc7112800 from 1 10000000:01000000:1.0:1784938417.702552:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938417.702581:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.702589:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.702598:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938417.702615:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938417.702720:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938417.703256:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910ccc6c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938417.703415:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144279424 00000100:00100000:0.0:1784938417.703422:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144279424 00000100:00100000:0.0:1784938417.703458:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784938417.703465:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+16:17870:x1871643144279424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938417.703478:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938417.703493:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef54b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.703529:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef54b expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.703551:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef54b expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938417.703559:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77a00, rc 0) 00000100:00100000:0.0:1784938417.703601:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144279424:12345-0@lo:101:mount.lustre.0 Request processed in 136us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938417.703608:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784938417.703809:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938417.703825:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.703835:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938417.704060:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938417.704093:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938417.704124:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938417.704157:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910ccc6c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938417.704210:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144279552 00000100:00100000:0.0:1784938417.704307:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144279552 00000100:00100000:0.0:1784938417.704332:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784938417.704339:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144279552:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938417.704424:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144279552:12345-0@lo:501:mount.lustre.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938417.704431:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784938417.704569:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938417.704592:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938417.704631:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938417.704786:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910ccc6c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938417.704834:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144279680 00000100:00100000:0.0:1784938417.704851:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144279680 00000100:00100000:0.0:1784938417.704871:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784938417.704876:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144279680:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938417.704954:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144279680:12345-0@lo:503:mount.lustre.0 Request processed in 76us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938417.704960:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938417.705086:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279680:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938417.705432:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938417.705493:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938417.705541:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938417.705560:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc40a0240 going to sleep for 11 seconds 00000100:00100000:3.0:1784938417.705806:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144279808 00000100:00100000:3.0:1784938417.705812:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144279808 00000100:00100000:3.0:1784938417.705859:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784938417.705867:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144279808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938417.705961:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144279808:12345-0@lo:502:mount.lustre.0 Request processed in 95us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.705968:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938417.706100:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938417.706321:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784938417.706346:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1784938417.706374:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1784938417.706388:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1784938417.706400:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1784938417.706411:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1784938417.706423:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1784938417.706435:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1784938417.706448:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784938417.706460:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1784938417.706471:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1784938417.706615:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938417.706732:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938417.706762:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc40a0240 going to sleep for 11 seconds 00000100:00100000:0.0:1784938417.706834:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144279936 00000100:00100000:0.0:1784938417.706853:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144279936 00000100:00100000:0.0:1784938417.706882:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784938417.706889:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144279936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938417.706982:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144279936:12345-0@lo:502:mount.lustre.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938417.706994:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784938417.707120:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144279936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938417.707162:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1784938417.707169:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1784938417.707807:0:17884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938417.707816:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.707825:0:17884:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784938417.707833:0:17884:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910bc7112800 00000020:00000080:1.0:1784938417.707835:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938417.707914:0:17884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938417.707918:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.707919:0:17884:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784938417.707922:0:17884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938417.707925:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.707926:0:17884:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784938417.707929:0:17884:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910bc7112800 00000020:00000080:1.0:1784938417.707931:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938417.707985:0:17884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938417.707989:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.707990:0:17884:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1784938417.707993:0:17884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938417.707995:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.707996:0:17884:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784938417.707999:0:17884:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910bc7112800 00000020:00000080:1.0:1784938417.708001:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938417.708016:0:17884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938417.708019:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.708020:0:17884:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784938417.708023:0:17884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938417.708026:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.708027:0:17884:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784938417.708030:0:17884:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910bc7112800 00000020:00000080:1.0:1784938417.708032:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938417.708053:0:17884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938417.708056:0:17884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938417.708057:0:17884:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784938417.708060:0:17884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1784938417.709419:0:17870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784938417.709459:0:17870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938417.709483:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.709511:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938417.709568:0:17870:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784938417.709571:0:17870:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910bc7112800 10000000:01000000:1.0:1784938417.709574:0:17870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910bc7112800 10000000:01000000:1.0:1784938417.709578:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938417.709583:0:17870:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910bc7112800 from 1 10000000:01000000:1.0:1784938417.709587:0:17870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938417.709621:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.709630:0:17870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938417.709769:0:17870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938417.709797:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938417.709925:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938417.709966:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc40a0780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938417.710580:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144280064 00000100:00100000:2.0:1784938417.710588:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144280064 00000100:00100000:3.0:1784938417.715911:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784938417.715926:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17870:x1871643144280064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938417.715958:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938417.716057:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc97d0c00/0x26783cd1c59ef560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef559 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.716096:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d0c00/0x26783cd1c59ef560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef559 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.716111:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc97d0c00/0x26783cd1c59ef560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef559 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.716120:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0c00, rc 0) 00000100:00100000:3.0:1784938417.716233:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280064:12345-0@lo:101:mount.lustre.0 Request processed in 311us (6307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.716241:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784938417.716284:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938417.716305:0:17870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef560 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.716315:0:17870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef560 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938417.718080:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1784938417.718789:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938417.719043:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1784938417.719071:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1784938417.719087:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1784938417.719114:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1784938417.719128:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1784938417.719140:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1784938417.719152:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1784938417.719162:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1784938417.719175:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1784938417.719189:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1784938417.719202:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1784938417.721001:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1784938417.721056:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1784938417.721073:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1784938417.721087:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1784938417.721100:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1784938417.721113:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1784938417.721126:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1784938417.721139:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1784938417.721152:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1784938417.721164:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1784938417.721176:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1784938417.721188:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1784938417.721199:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1784938417.721211:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1784938417.721253:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1784938417.721266:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1784938417.721279:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1784938417.721315:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1784938417.721323:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1784938417.721422:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938417.721488:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.721534:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938417.724342:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144280192 00000100:00100000:1.0:1784938417.724358:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144280192 00000100:00100000:1.0:1784938417.724415:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784938417.724426:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938417.724598:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280192:12345-0@lo:501:mount.lustre.0 Request processed in 174us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.724605:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938417.724819:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938417.724886:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938417.724928:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.724964:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938417.724979:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144280320 00000100:00100000:2.0:1784938417.724982:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144280320 00000100:00100000:2.0:1784938417.725012:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784938417.725018:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938417.725094:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280320:12345-0@lo:503:mount.lustre.0 Request processed in 76us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938417.725101:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784938417.725147:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280320:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784938417.726788:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938417.726880:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938417.726949:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.726984:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291be40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938417.727005:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144280448 00000100:00100000:2.0:1784938417.727010:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144280448 00000100:00100000:2.0:1784938417.727059:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784938417.727067:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938417.727173:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280448:12345-0@lo:502:mount.lustre.0 Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938417.727181:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784938417.729369:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784938417.729888:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1784938417.729920:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1784938417.729945:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1784938417.729958:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1784938417.729972:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1784938417.729984:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1784938417.729996:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1784938417.730010:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1784938417.730024:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1784938417.730036:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1784938417.730049:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1784938417.730062:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1784938417.730076:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1784938417.730106:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1784938417.730123:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1784938417.730136:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1784938417.730148:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1784938417.730160:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1784938417.730171:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1784938417.730183:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1784938417.730195:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1784938417.730206:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1784938417.731766:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1784938417.731805:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1784938417.731819:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1784938417.731830:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1784938417.731855:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1784938417.731870:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1784938417.731883:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1784938417.731921:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1784938417.731934:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1784938417.731946:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1784938417.731958:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1784938417.731969:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1784938417.731981:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1784938417.732004:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1784938417.732016:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1784938417.732029:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1784938417.732042:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1784938417.732052:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1784938417.732064:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1784938417.732077:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1784938417.732090:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1784938417.732103:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1784938417.732117:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1784938417.732142:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1784938417.732159:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1784938417.732172:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1784938417.733739:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938417.733825:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.733880:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291be40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938417.734344:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144280576 00000100:00100000:1.0:1784938417.734352:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144280576 00000100:00100000:1.0:1784938417.734404:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784938417.734413:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938417.734558:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280576:12345-0@lo:502:mount.lustre.0 Request processed in 146us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.734566:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784938417.734796:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784938417.737208:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1784938417.737352:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1784938417.737401:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938417.737604:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938417.737814:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144280704 00000100:00100000:0.0:1784938417.737822:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144280704 00000100:00100000:0.0:1784938417.737886:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784938417.737896:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938417.738013:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280704:12345-0@lo:502:mount.lustre.0 Request processed in 118us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938417.738022:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784938417.738162:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd291be40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938417.738184:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784938417.738625:0:17870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1784938417.738639:0:17870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784938417.743589:0:17888:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1784938417.743608:0:17888:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff910cecfa0000) 00000020:00000080:0.0:1784938417.743631:0:17888:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1784938417.749373:0:17888:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910bc7112800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1784938417.749383:0:17888:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910bc7112800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1784938417.749387:0:17888:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910bc7112800 3 00010000:00080000:1.0:1784938417.749432:0:17888:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910cdf5ca800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1784938417.752291:0:17888:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1784938417.752395:0:17888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1784938417.752441:0:17888:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784938417.752455:0:17888:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x26783cd1c59ef56e 00000100:00080000:1.0:1784938417.752539:0:17888:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:1.0:1784938417.752552:0:17888:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff910cdf5ca800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:1.0:1784938417.752587:0:17888:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc678ce00 x1871643144280832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938417.752609:0:17888:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784938417.752633:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871643144280832:192.168.203.126@tcp:38:llog_process_th.0 00000100:00080000:2.0:1784938417.752794:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938417.752799:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938417.752802:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938417.752811:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938417.754793:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938417.754861:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144280832 00000100:00100000:3.0:1784938417.754869:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144280832 00000100:00100000:3.0:1784938417.754904:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:3.0:1784938417.754911:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1871643144280832:12345-192.168.203.126@tcp:38:llog_process_th.0 00010000:00080000:3.0:1784938417.754939:0:17141:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1784938417.755067:0:17141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x26783cd1c59ef575 00000004:00100000:3.0:1784938417.755133:0:17141:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784938417.755172:0:17141:0:(import.c:65:import_set_state_nolock()) ffff910bc7c66000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938417.756199:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1871643144280832:12345-192.168.203.126@tcp:38:llog_process_th.0 Request processed in 1281us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.756210:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00000040:00080000:1.0:1784938417.756445:0:17888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00010000:00080000:0.0:1784938417.757761:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910bc678ce00 x1871643144280832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938417.757777:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938417.757787:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1784938417.757796:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784938417.757801:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784938417.757805:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdf5ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784938417.757812:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1871643144280832:192.168.203.126@tcp:38:llog_process_th.0 00000020:01000000:3.0:1784938417.758274:0:17870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784938417.758314:0:17870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938417.758340:0:17870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef560 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.758351:0:17870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d0215b200/0x26783cd1c59ef559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef560 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784938417.758399:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784938417.758401:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784938417.758402:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938417.758403:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938417.758405:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938417.758406:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938417.758407:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938417.758409:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938417.758410:0:17870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938417.758414:0:17870:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1784938417.758416:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938417.758418:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784938417.758419:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938417.758420:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938417.758421:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938417.758422:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938417.758423:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938417.758424:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938417.758425:0:17870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784938417.758447:0:17870:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1784938417.758465:0:17870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280960:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784938417.758534:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938417.758567:0:17870:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7335f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938417.759287:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144280960 00000100:00100000:2.0:1784938417.759295:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144280960 00000100:00100000:2.0:1784938417.759347:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784938417.759392:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17870:x1871643144280960:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938417.759419:0:17131:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784938417.759432:0:17131:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1784938417.763147:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1784938417.763340:0:17131:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784938417.763358:0:17131:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1784938417.763598:0:17155:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784938417.763603:0:17155:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784938417.763625:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.763666:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef479 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.763674:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef53d expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.763682:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.763720:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef53d expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.763733:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef53d expref: 18 pid: 17133 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938417.763747:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144281088:0@lo:104: 00000100:00100000:3.0:1784938417.763809:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784938417.763868:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef479 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.763876:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef479 expref: 18 pid: 17131 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938417.763886:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144281216:0@lo:104: 00000100:00100000:3.0:1784938417.763907:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938417.763927:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7335b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938417.763952:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144281088 00000100:00100000:3.0:1784938417.763959:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144281088 00000100:00100000:3.0:1784938417.763994:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144281216 00000100:00100000:3.0:1784938417.764001:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144281216 00000100:00100000:3.0:1784938417.764019:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938417.764027:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:17155:x1871643144281088:12345-0@lo:104: 00010000:00010000:3.0:1784938417.764040:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.764090:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938417.764096:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:17155:x1871643144281088:12345-0@lo:104: Request processed in 71us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.764103:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938417.764118:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938417.764124:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:17155:x1871643144281216:12345-0@lo:104: 00010000:00010000:3.0:1784938417.764131:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938417.764162:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784938417.764167:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:17155:x1871643144281216:12345-0@lo:104: Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.764173:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938417.764205:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144281088:0@lo:104: 00000100:00100000:3.0:1784938417.764247:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144281216:0@lo:104: 00010000:00010000:3.0:1784938417.764263:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765013:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938417.765023:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765033:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938417.765037:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765046:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938417.765053:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938417.765059:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938417.765095:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765102:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938417.765132:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765149:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b77800/0x26783cd1c59ef53d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef544 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765164:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938417.765167:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765172:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77e00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938417.765175:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765182:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938417.765188:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938417.765193:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938417.765207:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765300:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784938417.765300:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144281344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938417.765307:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765313:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef480 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765326:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938417.765333:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938417.765334:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938417.765341:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938417.765345:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938417.765358:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144281472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938417.765385:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938417.765395:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144281344 00000100:00100000:1.0:1784938417.765400:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144281344 00000100:00100000:2.0:1784938417.765425:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144281472 00000100:00100000:2.0:1784938417.765429:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144281472 00010000:00010000:2.0:1784938417.765449:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef479 expref: 20 pid: 17131 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938417.765474:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784938417.765482:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:3643:x1871643144281472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938417.765492:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938417.765560:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef53d expref: 20 pid: 17133 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765565:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef479 expref: 20 pid: 17131 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.765574:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef479 expref: 20 pid: 17131 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938417.765582:0:17124:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1784938417.765587:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d0215ae00/0x26783cd1c59ef480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef479 expref: 20 pid: 17131 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938417.765589:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1784938417.765600:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938417.765633:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:3643:x1871643144281472:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938417.765639:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938417.765937:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:17870:x1871643144280960:12345-0@lo:253:mount.lustre.0 Request processed in 6547us (7402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938417.765946:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784938417.766008:0:17870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17870:1871643144280960:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784938417.766021:0:17870:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1784938417.766024:0:17870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938417.766026:0:17870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784938417.766028:0:17870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938417.766029:0:17870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938417.766030:0:17870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938417.766031:0:17870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938417.766032:0:17870:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938417.766034:0:17870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938417.766035:0:17870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784938417.766054:0:17870:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1784938417.766338:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784938417.766346:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:3642:x1871643144281344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938417.766356:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938417.766368:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef53d expref: 17 pid: 17133 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766378:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef53d expref: 17 pid: 17133 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766390:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef53d expref: 17 pid: 17133 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766401:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766409:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938417.766421:0:17125:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006782271s 00010000:00010000:2.0:1784938417.766426:0:17125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766433:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766440:0:17125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766446:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766452:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938417.766456:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766477:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766897:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.766913:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938417.766965:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+16:3642:x1871643144281344:12345-0@lo:103:ldlm_bl.0 Request processed in 619us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938417.766972:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784938417.767011:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144281472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938417.767050:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144281344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938417.767068:0:17155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.767075:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938417.767081:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef57c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1784938417.792962:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1784938417.794728:0:17897:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1784938417.794736:0:17897:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1784938417.794828:0:17898:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784938417.795080:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1784938417.795553:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938417.797192:0:17899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17899:1871643144281600:192.168.203.126@tcp:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784938417.797297:0:17899:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd3930c0 going to sleep for 11 seconds 00000040:01000000:0.0:1784938417.798691:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1784938417.798764:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784938417.800159:0:17870:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784938417.800175:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1784938417.800210:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000040:00080000:3.0:1784938417.800618:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784938417.800701:0:17898:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1784938417.800716:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938417.801142:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144281600 00000100:00100000:1.0:1784938417.801152:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144281600 00000100:00100000:1.0:1784938417.801206:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:1.0:1784938417.801364:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17899:x1871643144281600:12345-192.168.203.126@tcp:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784938417.801538:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17899:x1871643144281600:12345-192.168.203.126@tcp:1000:lod0001_rec0000.0 Request processed in 323us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.801545:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00000040:00080000:0.0:1784938417.801873:0:17870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1784938417.802149:0:17899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17899:1871643144281600:192.168.203.126@tcp:1000:lod0001_rec0000.0 00000040:01000000:2.0:1784938417.802186:0:17899:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1784938417.802440:0:17870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784938417.802756:0:17870:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1784938417.802865:0:17870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784938417.803528:0:17870:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1784938417.804768:0:17899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17899:1871643144281728:192.168.203.126@tcp:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784938417.804904:0:17899:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938417.805179:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938417.806180:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144281728 00000100:00100000:1.0:1784938417.806192:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144281728 00000100:00100000:1.0:1784938417.806663:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:1.0:1784938417.806675:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17899:x1871643144281728:12345-192.168.203.126@tcp:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784938417.807574:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17899:x1871643144281728:12345-192.168.203.126@tcp:1000:lod0001_rec0000.0 Request processed in 897us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.807584:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:1.0:1784938417.807906:0:17899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17899:1871643144281728:192.168.203.126@tcp:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784938417.808010:0:17899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17899:1871643144281856:192.168.203.126@tcp:900:lod0001_rec0000.0 00000100:00100000:1.0:1784938417.808077:0:17899:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938417.808293:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938417.808380:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144281856 00000100:00100000:1.0:1784938417.808387:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144281856 00000100:00100000:1.0:1784938417.808423:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:1.0:1784938417.808431:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17899:x1871643144281856:12345-192.168.203.126@tcp:900:lod0001_rec0000.0 00000100:00100000:1.0:1784938417.808643:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17899:x1871643144281856:12345-192.168.203.126@tcp:900:lod0001_rec0000.0 Request processed in 212us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938417.808726:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000001:00000004:2.0:1784938417.808797:0:17870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:1.0:1784938417.808979:0:17899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910bc678d880 x1871643144281856/t0(0) o900->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:29/10 lens 264/248 e 0 to 0 dl 1784938433 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938417.808992:0:17899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17899:1871643144281856:192.168.203.126@tcp:900:lod0001_rec0000.0 00000100:00100000:1.0:1784938417.809047:0:17899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17899:1871643144281984:192.168.203.126@tcp:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784938417.809093:0:17899:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938417.809260:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938417.809373:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144281984 00000100:00100000:0.0:1784938417.809380:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144281984 00000100:00100000:0.0:1784938417.809421:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:0.0:1784938417.809431:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17899:x1871643144281984:12345-192.168.203.126@tcp:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784938417.809503:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17899:x1871643144281984:12345-192.168.203.126@tcp:1000:lod0001_rec0000.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938417.809511:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:0.0:1784938417.810701:0:17899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17899:1871643144281984:192.168.203.126@tcp:1000:lod0001_rec0000.0 00000040:00080000:0.0:1784938417.810767:0:17899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1784938417.811386:0:17870:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784938417.811524:0:17870:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb7d5418a7988 00100000:10000000:3.0:1784938417.811532:0:17870:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1784938417.811983:0:17870:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784938417.812013:0:17870:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784938417.812031:0:17870:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784938417.812056:0:17870:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:0.0:1784938417.812890:0:17899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784938417.812952:0:17899:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784938417.812958:0:17899:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:3.0:1784938417.813660:0:17870:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938417.813908:0:17870:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784938417.951544:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938418.400575:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784938418.785023:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784938418.975346:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 10000000:01000000:2.0:1784938419.103518:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784938419.103529:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910bc7112800 from 8 10000000:01000000:2.0:1784938419.103536:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784938419.103600:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938419.103613:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938419.103626:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938419.103659:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2072d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144282112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938419.103767:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938419.103975:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc6063000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938419.105643:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144282112 00000100:00100000:0.0:1784938419.105665:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144282112 00000100:00100000:0.0:1784938419.105820:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784938419.105842:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+16:17136:x1871643144282112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938419.105866:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938419.105893:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef583 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938419.105937:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef583 expref: 17 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938419.105968:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef583 expref: 17 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938419.105979:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76400, rc 0) 00000100:00100000:0.0:1784938419.106084:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144282112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938419.106092:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784938419.106157:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2072d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144282112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938419.106189:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938419.106200:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938419.106369:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144282240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784938419.106429:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938419.117164:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7335240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938419.117483:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144282240 00000100:00100000:2.0:1784938419.117496:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144282240 00000100:00100000:2.0:1784938419.117561:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784938419.117572:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144282240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784938419.117605:0:17133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784938419.117628:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784938419.117631:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1784938419.118068:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144282240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 495us (11636us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938419.118078:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784938419.118165:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144282240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784938419.118687:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784938419.118701:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938419.118715:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938419.118727:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784938419.118730:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cc871e000 from 8 10000000:01000000:2.0:1784938419.118733:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784938419.118776:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938419.118785:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938419.118796:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938419.118823:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144282368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938419.118881:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938419.119029:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938419.119075:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144282368 00000100:00100000:0.0:1784938419.119082:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144282368 00000100:00100000:3.0:1784938419.119169:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784938419.119188:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144282368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938419.119203:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938419.119246:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef591 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938419.119358:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef591 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938419.119371:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef591 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938419.119388:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1e00, rc 0) 00000100:00100000:3.0:1784938419.119439:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17136:x1871643144282368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938419.119454:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784938419.122414:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144282368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938419.122461:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938419.122478:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938419.122599:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144282496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784938419.122709:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938419.122763:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc77bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938419.123162:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144282496 00000100:00100000:3.0:1784938419.123173:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144282496 00000100:00100000:3.0:1784938419.123423:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784938419.123435:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17136:x1871643144282496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784938419.123470:0:17131:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784938419.123495:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784938419.123498:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1784938419.123639:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17136:x1871643144282496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 206us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938419.123647:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784938419.123820:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144282496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784938419.124768:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784938419.124789:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938419.124802:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938419.425249:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784938419.808903:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784938419.999578:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:2.0:1784938420.447591:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938421.023417:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00010000:00010000:3.0:1784938421.471551:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938422.048517:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 0 seconds 00000001:02000400:3.0:1784938422.358979:0:18141:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784938422.497185:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938422.944360:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938422.944386:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144282624:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938422.944663:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938422.944826:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144282624 00000100:00100000:1.0:1784938422.944835:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144282624 00000100:00100000:1.0:1784938422.944884:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:1.0:1784938422.944894:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144282624:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:1.0:1784938422.944928:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784938422.944976:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144282624:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 84us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938422.944998:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:0.0:1784938422.945566:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144282624:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00080000:2.0:1784938422.954254:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784938422.954261:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784938422.954265:0:8:0:(import.c:65:import_set_state_nolock()) ffff910ce6b6c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938422.954278:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff910ce6b6c000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938422.954314:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cd2071f80 x1871643144282880/t0(0) o38->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938422.954333:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938422.954337:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938422.954340:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938422.954343:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938422.954372:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938422.954375:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938422.954378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938422.954381:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938422.954419:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938422.954436:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144282752:0@lo:400:kworker.0 00000100:00100000:2.0:1784938422.954505:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938422.954561:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144282880:192.168.203.126@tcp:38:kworker.0 00000100:00100000:2.0:1784938422.954627:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144283008:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938422.954659:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938422.954665:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144283136:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938422.954707:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144282752 00000100:00100000:2.0:1784938422.954714:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144282752 00000100:00100000:2.0:1784938422.954757:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784938422.954765:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:3640:x1871643144282752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938422.954827:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:3640:x1871643144282752:12345-0@lo:400:kworker.0 Request processed in 62us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938422.954834:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784938422.955005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938422.955046:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938422.955066:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938422.955090:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144282880 00000100:00100000:2.0:1784938422.955094:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144282880 00000100:00100000:2.0:1784938422.955115:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:2.0:1784938422.955129:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1871643144282880:12345-192.168.203.126@tcp:38:kworker.0 00010000:00080000:2.0:1784938422.955152:0:17144:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:2.0:1784938422.955188:0:17144:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ef59f 00000004:00100000:2.0:1784938422.955200:0:17144:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1784938422.955205:0:17144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1784938422.955294:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144283008 00000100:00100000:2.0:1784938422.955298:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144283008 00000100:00100000:2.0:1784938422.955324:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144283136 00000100:00100000:2.0:1784938422.955328:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144283136 00000100:00100000:2.0:1784938422.955341:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:2.0:1784938422.955347:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144283008:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938422.955384:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144283008:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938422.955391:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:2.0:1784938422.955404:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:2.0:1784938422.955409:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144283136:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938422.955431:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144283136:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938422.955436:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:2.0:1784938422.955474:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144282752:0@lo:400:kworker.0 00010000:00080000:2.0:1784938422.955587:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cd2070a80 x1871643144283136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938422.955599:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144283136:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938422.955610:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cd2070700 x1871643144283008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938422.955628:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144283008:192.168.203.126@tcp:400:kworker.0 00000100:00080000:1.0:1784938422.980050:0:17144:0:(import.c:65:import_set_state_nolock()) ffff910cdf5ce000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938422.980134:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1871643144282880:12345-192.168.203.126@tcp:38:kworker.0 Request processed in 25003us (25127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938422.980145:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00080000:3.0:1784938422.980533:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784938422.980543:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784938422.980549:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784938422.980551:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910ce6b6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1784938422.980567:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f849daa4): req@ffff910cffbffb80 x1871643144275840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@192.168.203.126@tcp:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938422.980585:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144282880:192.168.203.126@tcp:38:kworker.0 00000100:00100000:3.0:1784938422.980991:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc9bcd540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938422.981021:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144283264:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938422.983815:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938422.983853:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938422.983924:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144275840 00000100:00100000:3.0:1784938422.983933:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144275840 00000100:00100000:3.0:1784938422.983979:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144283264 00000100:00100000:3.0:1784938422.983983:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144283264 00000100:00100000:3.0:1784938422.983999:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:3.0:1784938422.984007:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17180:x1871643144275840:12345-192.168.203.126@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938422.984114:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17180:x1871643144275840:12345-192.168.203.126@tcp:1000:lod0000_rec0001.0 Request processed in 107us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938422.984122:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:3.0:1784938422.984137:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:3.0:1784938422.984143:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1871643144283264:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938422.984178:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784938422.984246:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1871643144283264:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 102us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938422.984254:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:3.0:1784938422.984466:0:17180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbffb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1871643144275840:192.168.203.126@tcp:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784938422.984506:0:17180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784938422.984546:0:17180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1871643144283392:192.168.203.126@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938422.984601:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94e7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938422.984644:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144283264:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938422.984714:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938422.984732:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144283392 00000100:00100000:3.0:1784938422.984737:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144283392 00000100:00100000:3.0:1784938422.984756:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:3.0:1784938422.984763:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1871643144283392:12345-192.168.203.126@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938422.984979:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1871643144283392:12345-192.168.203.126@tcp:1000:lod0000_rec0001.0 Request processed in 215us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938422.984986:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:3.0:1784938422.985074:0:17180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1871643144283392:192.168.203.126@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938422.985141:0:17180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1871643144283520:192.168.203.126@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938422.985174:0:17180:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94e7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938422.985264:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938422.985281:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144283520 00000100:00100000:3.0:1784938422.985286:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144283520 00000100:00100000:3.0:1784938422.985314:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:3.0:1784938422.985320:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1871643144283520:12345-192.168.203.126@tcp:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784938422.985366:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17180:x1871643144283520:12345-192.168.203.126@tcp:1000:lod0000_rec0001.0 Request processed in 45us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938422.985373:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:3.0:1784938422.985465:0:17180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1871643144283520:192.168.203.126@tcp:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784938422.985510:0:17180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938422.988570:0:17180:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784938422.988724:0:17180:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:3.0:1784938422.988729:0:17180:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1784938423.267549:0:18194:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784938423.267749:0:18194:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784938423.520754:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784938424.199290:0:18244:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938424.199487:0:18244:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784938424.544829:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784938425.255479:0:18293:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdf65e230 20000000:00000080:1.0:1784938425.255496:0:18293:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910cdf5f9000 uarg=0000000000000000 20000000:01000000:1.0:1784938425.255542:0:18293:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784938425.255549:0:18293:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784938425.255554:0:18293:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784938425.256098:0:18294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1784938425.256279:0:18293:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784938425.266694:0:18293:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784938425.270493:0:18293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.270516:0:18293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef448 expref: 17 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.270523:0:18293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef54b expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.270530:0:18293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.270573:0:18293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef54b expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.270676:0:18293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef54b expref: 17 pid: 17133 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938425.270692:0:18293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18293:1871643144283648:0@lo:104: 00000100:00100000:0.0:1784938425.270763:0:18293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938425.270870:0:18293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef448 expref: 17 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.270880:0:18293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef448 expref: 17 pid: 17131 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938425.270889:0:18293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18293:1871643144283776:0@lo:104: 00000100:00100000:0.0:1784938425.270912:0:18293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938425.273839:0:18293:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc73350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938425.274241:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144283648 00000100:00100000:2.0:1784938425.274251:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144283648 00000100:00100000:2.0:1784938425.274291:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144283776 00000100:00100000:2.0:1784938425.274294:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144283776 00000100:00100000:2.0:1784938425.274312:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938425.274321:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:18293:x1871643144283648:12345-0@lo:104: 00010000:00010000:2.0:1784938425.274342:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.274452:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938425.274458:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:18293:x1871643144283648:12345-0@lo:104: Request processed in 140us (3696us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938425.274465:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938425.274484:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784938425.274489:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:18293:x1871643144283776:12345-0@lo:104: 00010000:00010000:2.0:1784938425.274496:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.274528:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784938425.274533:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:18293:x1871643144283776:12345-0@lo:104: Request processed in 44us (3620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938425.274537:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1784938425.274554:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938425.274560:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938425.274743:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784938425.274839:0:18293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18293:1871643144283648:0@lo:104: 00000100:00100000:0.0:1784938425.274849:0:18293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18293:1871643144283776:0@lo:104: 00010000:00010000:0.0:1784938425.274872:0:18293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.275114:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938425.275120:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.275130:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938425.275138:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938425.275145:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938425.275186:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.275192:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938425.275242:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.275250:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d0215a200/0x26783cd1c59ef54b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef552 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.275265:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938425.275267:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938425.275269:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938425.275553:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144283904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938425.275614:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938425.275971:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144283904 00000100:00100000:2.0:1784938425.275978:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144283904 00010000:00010000:2.0:1784938425.276005:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef54b expref: 18 pid: 17133 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938425.276047:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938425.276063:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:3641:x1871643144283904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938425.276078:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938425.276084:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef54b expref: 18 pid: 17133 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.276095:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef54b expref: 18 pid: 17133 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.276112:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77a00/0x26783cd1c59ef552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef54b expref: 18 pid: 17133 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938425.276126:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938425.276174:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:3641:x1871643144283904:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938425.276180:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1784938425.276255:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938425.276258:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938425.276259:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938425.276590:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144283904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938425.276739:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938425.276749:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b800 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:1.0:1784938425.276753:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938425.276761:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938425.276767:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938425.276781:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784938425.276821:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938425.276827:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938425.276855:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938425.276863:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910d0215b800/0x26783cd1c59ef448 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef44f expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938425.276878:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938425.276880:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938425.276882:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938425.276888:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938425.276897:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144284032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938425.276936:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938425.277103:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144284032 00000100:00100000:0.0:1784938425.277108:0:17893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144284032 00010000:00010000:0.0:1784938425.277128:0:17893:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef448 expref: 17 pid: 17131 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938425.277161:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938425.277168:0:17893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:3643:x1871643144284032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938425.277186:0:17893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938425.277191:0:17893:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef448 expref: 17 pid: 17131 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277200:0:17893:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef448 expref: 17 pid: 17131 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277254:0:17893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d0215a000/0x26783cd1c59ef44f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef448 expref: 17 pid: 17131 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277269:0:17893:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277276:0:17893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277290:0:17893:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277297:0:17893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277304:0:17893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277311:0:17893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277316:0:17893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938425.277320:0:17893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277338:0:17893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277352:0:17893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277362:0:17893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938425.277410:0:17893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+16:3643:x1871643144284032:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938425.277417:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938425.277451:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144284032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938425.277472:0:18293:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277481:0:18293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.277488:0:18293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76200/0x26783cd1c59ef5a6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938425.567420:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784938426.080152:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784938426.592119:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784938426.978535:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938426.978545:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910bc7112800 from 13 10000000:01000000:2.0:1784938426.978550:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938426.978595:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938426.978606:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938426.978627:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938426.978672:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938426.978742:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938426.978793:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938426.978851:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144284160 00000100:00100000:0.0:1784938426.978859:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144284160 00000100:00100000:0.0:1784938426.978913:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784938426.978922:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+16:17136:x1871643144284160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938426.978934:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938426.978949:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef5ad expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938426.978978:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef5ad expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938426.978988:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef5ad expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938426.978998:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77c00, rc 0) 00000100:00100000:0.0:1784938426.979040:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144284160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938426.979046:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784938426.979639:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938426.979658:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938426.979678:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938426.979749:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938426.979792:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938426.979817:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94e7180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938426.980175:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144284288 00000100:00100000:2.0:1784938426.980181:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144284288 00000100:00100000:2.0:1784938426.980254:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784938426.980262:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144284288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938426.980377:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144284288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938426.980385:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784938426.980848:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938426.980889:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938426.980945:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938426.980977:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94e7180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938426.981033:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144284416 00000100:00100000:2.0:1784938426.981037:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144284416 00000100:00100000:2.0:1784938426.981072:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784938426.981078:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144284416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938426.981173:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144284416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938426.981180:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784938426.981398:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938426.982580:0:18363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784938426.983334:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784938426.983366:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938426.983377:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938426.983391:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938426.983403:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938426.983417:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cc871e000 from 13 10000000:01000000:2.0:1784938426.983421:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938426.983459:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938426.983467:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938426.983477:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938426.983501:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938426.983841:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938426.983887:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674de40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938426.983936:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144284544 00000100:00100000:0.0:1784938426.983944:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144284544 00000100:00100000:0.0:1784938426.983991:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784938426.984000:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+17:17136:x1871643144284544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938426.984013:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938426.984026:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef5bb expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938426.984048:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef5bb expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938426.984058:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef5bb expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938426.984067:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76800, rc 0) 00000100:00100000:0.0:1784938426.984555:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17136:x1871643144284544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 555us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938426.984562:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784938426.989830:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938426.989860:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938426.989873:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938426.989957:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938426.990022:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938426.990112:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94e7600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938426.990166:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144284672 00000100:00100000:2.0:1784938426.990173:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144284672 00000100:00100000:2.0:1784938426.991283:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784938426.991298:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17136:x1871643144284672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938426.991456:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17136:x1871643144284672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938426.991464:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784938426.991688:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938426.991733:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938426.991796:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938426.991834:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94e7600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938426.992206:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144284800 00000100:00100000:0.0:1784938426.992243:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144284800 00000100:00100000:0.0:1784938426.992277:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784938426.992284:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd29dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17136:x1871643144284800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938426.992381:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd29dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:17136:x1871643144284800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938426.992387:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784938426.992517:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144284800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784938426.994136:0:18364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1784938426.994695:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1784938426.994725:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938426.994738:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938426.994748:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938427.039985:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938417/real 1784938417] req@ffff910cffbfca80 x1871643144279040/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938427.040019:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910cffbfca80 x1871643144279040/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938427.040030:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938417/real 1784938417] req@ffff910cffbfc380 x1871643144278912/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938427.040060:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910cffbfc380 x1871643144278912/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938427.040078:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938427.040103:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:1.0:1784938427.040108:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144279040:192.168.203.126@tcp:8:llog_process_th.0 00000100:00080000:1.0:1784938427.040113:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdfb54000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938427.040119:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:1.0:1784938427.040122:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144278912:192.168.203.126@tcp:8:llog_process_th.0 00000100:00080000:0.0:1784938427.040266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938427.040271:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784938427.040274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938427.040276:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784938427.040301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938427.040305:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784938427.040308:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cdfb54000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938427.040313:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 485 00000100:00080000:0.0:1784938427.040327:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784938427.040335:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff910cdfb54000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938427.040356:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbff480 x1871643144285312/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938427.040369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938427.040372:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784938427.040373:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938427.040377:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 485 00000100:00080000:0.0:1784938427.040380:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784938427.040383:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff910cdf495800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938427.040395:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfdf80 x1871643144285440/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938427.040428:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144285568:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938427.040501:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938427.040508:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144284928:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938427.040544:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144285056:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938427.040571:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938427.040577:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144285184:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938427.040930:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938427.040958:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938427.040984:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144284928 00000100:00100000:1.0:1784938427.040991:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144284928 00000100:00100000:1.0:1784938427.041029:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144285184 00000100:00100000:1.0:1784938427.041032:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144285184 00000100:00100000:1.0:1784938427.041050:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:1.0:1784938427.041058:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144284928:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938427.041103:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144284928:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938427.041111:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:1.0:1784938427.041128:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:1.0:1784938427.041135:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144285184:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938427.041160:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144285184:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938427.041179:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:1.0:1784938427.041206:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144285312:192.168.203.126@tcp:8:kworker.0 00000100:00100000:1.0:1784938427.041421:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144285440:192.168.203.126@tcp:8:kworker.0 00000100:00100000:1.0:1784938427.042420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938427.042449:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000400:00000100:1.0:1784938427.042495:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144285312 offset 0 length 520: 4 00000400:00000100:1.0:1784938427.042507:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144285440 offset 0 length 520: 4 00000100:00100000:1.0:1784938427.042530:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144285568 00000100:00100000:1.0:1784938427.042536:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144285568 00000100:00100000:1.0:1784938427.042571:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144285056 00000100:00100000:1.0:1784938427.042575:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144285056 00000100:00100000:1.0:1784938427.042591:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:1.0:1784938427.042612:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144285568:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938427.042768:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144284928:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938427.042812:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144285184:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938427.045970:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144285568:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 3359us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938427.045984:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:1.0:1784938427.046019:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:1.0:1784938427.046030:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144285056:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938427.046067:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144285056:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 41us (3617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938427.046074:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00010000:00080000:0.0:1784938427.046484:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cffbfc000 x1871643144285568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938427.046520:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144285568:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938427.046559:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cffbfd180 x1871643144285056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938427.046569:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144285056:192.168.203.126@tcp:400:kworker.0 00010000:00010000:2.0:1784938427.617729:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938428.063821:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938428.064765:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144285824:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938428.065137:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938428.065279:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144285824 00000100:00100000:3.0:1784938428.065290:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144285824 00000100:00100000:3.0:1784938428.065368:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:3.0:1784938428.065380:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1871643144285824:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938428.065432:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784938428.065831:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1871643144285824:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 451us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938428.065841:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:3.0:1784938428.066196:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144285824:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938428.067528:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144285696:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938428.069861:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938428.070044:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144285696 00000100:00100000:0.0:1784938428.070056:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144285696 00000100:00100000:0.0:1784938428.070123:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:0.0:1784938428.070137:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144285696:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938428.070187:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784938428.070294:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144285696:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 160us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938428.070311:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:2.0:1784938428.070558:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144285696:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:0.0:1784938428.639363:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784938429.034350:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784938429.093048:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938414/real 1784938414] req@ffff910bc678fb80 x1871643144276992/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938429 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938429.093096:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910bc678fb80 x1871643144276992/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938429 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938429.093124:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938414/real 1784938414] req@ffff910bc678ed80 x1871643144277120/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938429 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938429.093139:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910bc678ed80 x1871643144277120/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938429 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938429.093166:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc9069000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938429.093197:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:2.0:1784938429.093202:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144276992:192.168.203.126@tcp:8:kworker.0 00000100:00080000:2.0:1784938429.093209:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938429.093247:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:2.0:1784938429.093251:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144277120:192.168.203.126@tcp:8:kworker.0 00000100:00100000:0.0:1784938429.093496:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144285952:0@lo:400:kworker.0 00000100:00100000:0.0:1784938429.093588:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938429.093684:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144285952 00000100:00100000:2.0:1784938429.093693:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144285952 00000100:00100000:2.0:1784938429.093751:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784938429.093760:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:3641:x1871643144285952:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784938429.094287:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938429.094294:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784938429.094297:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cc9069000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938429.094306:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 482 00000100:00080000:1.0:1784938429.094314:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784938429.094321:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff910cc9069000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:1.0:1784938429.094349:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc678df80 x1871643144286208/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938429.094365:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938429.094369:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784938429.094371:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938429.094376:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 482 00000100:00080000:1.0:1784938429.094379:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784938429.094384:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910cc487f000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:1.0:1784938429.094397:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc678f480 x1871643144286336/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000001:00100000:3.0:1784938429.099167:0:17871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784938429.100315:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:3641:x1871643144285952:12345-0@lo:400:kworker.0 Request processed in 6539us (6711us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938429.100336:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784938429.100452:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144286080:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938429.100559:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938429.100568:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144286464:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938429.100619:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144286208:192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938429.100661:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144286336:192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938429.100931:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000400:00000100:2.0:1784938429.101023:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144286208 offset 0 length 520: 4 00000100:00100000:2.0:1784938429.101052:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000400:00000100:2.0:1784938429.101073:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.126@tcp portal 28 match 1871643144286336 offset 0 length 520: 4 00000100:00100000:2.0:1784938429.101098:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144286080 00000100:00100000:2.0:1784938429.101109:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144286080 00000100:00100000:2.0:1784938429.101158:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:2.0:1784938429.101168:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144286080:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938429.101266:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144286080:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 98us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938429.101274:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:2.0:1784938429.101297:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144286464 00000100:00100000:2.0:1784938429.101301:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144286464 00000100:00100000:2.0:1784938429.101330:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:2.0:1784938429.101337:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144286464:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938429.101368:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144286464:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938429.101374:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00010000:00080000:2.0:1784938429.101518:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910bc678ed80 x1871643144286464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938429.101537:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144286464:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938429.101549:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144286080:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938429.101633:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144286592:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938429.101758:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938429.101795:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144286592 00000100:00100000:2.0:1784938429.101800:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144286592 00000100:00100000:2.0:1784938429.101823:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:2.0:1784938429.101829:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144286592:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938429.101859:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144286592:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 29us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938429.101866:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:2.0:1784938429.101945:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144286592:192.168.203.126@tcp:400:kworker.0 00000100:00080000:1.0:1784938429.103671:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938429.103682:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938429.103686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938429.103690:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938429.103895:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938429.103926:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144286720:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938429.104197:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144285952:0@lo:400:kworker.0 00000100:00100000:3.0:1784938429.104981:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938429.105069:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144286720 00000100:00100000:1.0:1784938429.105080:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144286720 00000100:00100000:1.0:1784938429.105158:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:1.0:1784938429.105171:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144286720:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938429.105307:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144286720:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 138us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938429.105316:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00010000:00080000:2.0:1784938429.105554:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910bc678c700 x1871643144286720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938429.105574:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144286720:192.168.203.126@tcp:400:kworker.0 00010000:00010000:2.0:1784938429.665742:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938430.688574:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938431.711948:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784938432.379700:0:18642:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:0.0:1784938432.379704:0:18642:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1784938432.379706:0:18642:0:(obd_mount.c:925:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1784938432.379837:0:18642:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff910cdf54e800 00000020:01000004:0.0:1784938432.379854:0:18642:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784938432.379997:0:18642:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784938432.380018:0:18642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff910cecfa3380) 00000020:00000080:0.0:1784938432.380037:0:18642:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784938432.464376:0:18642:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784938432.466386:0:18642:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1784938432.466654:0:18642:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784938432.467150:0:18642:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784938432.467760:0:18642:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784938432.468084:0:18642:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784938432.468543:0:18642:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1784938432.472533:0:18642:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784938432.472809:0:18642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784938432.472824:0:18642:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784938432.472836:0:18642:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26783cd1c59ef5d0 00000020:01000004:2.0:1784938432.472843:0:18642:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784938432.472946:0:18642:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784938432.472950:0:18642:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784938432.472957:0:18642:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784938432.472962:0:18642:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784938432.472975:0:18642:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff910bc7543380) 00000020:00000080:2.0:1784938432.472987:0:18642:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1784938432.474173:0:18642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938432.474376:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784938432.474382:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784938432.479992:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784938432.480009:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1784938432.481555:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1784938432.481566:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1784938432.486964:0:18642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938432.487494:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1784938432.487502:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1784938432.489758:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1784938432.489772:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1784938432.520364:0:18642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938432.520561:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784938432.520567:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1784938432.533000:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784938432.533015:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1784938432.540336:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784938432.543173:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1784938432.551029:0:18642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938432.551491:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1784938432.551504:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784938432.552080:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784938432.552180:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784938432.700505:0:18642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938432.700765:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784938432.700771:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784938432.702533:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784938432.702544:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1784938432.703024:0:18642:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1784938432.703330:0:18642:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1784938432.703337:0:18642:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1784938432.717363:0:18642:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784938432.717469:0:18642:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1784938432.717473:0:18642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784938432.717475:0:18642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784938432.717476:0:18642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938432.717477:0:18642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938432.717479:0:18642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938432.717480:0:18642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938432.717481:0:18642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938432.717483:0:18642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938432.717484:0:18642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938432.717488:0:18642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1784938432.717490:0:18642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938432.717492:0:18642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784938432.717493:0:18642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938432.717494:0:18642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938432.717495:0:18642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938432.717496:0:18642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938432.717497:0:18642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938432.717498:0:18642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938432.717499:0:18642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938432.717525:0:18642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784938432.717545:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144286848:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784938432.717693:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938432.717803:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938432.717886:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144286848 00000100:00100000:2.0:1784938432.717894:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144286848 00000100:00100000:2.0:1784938432.717984:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784938432.717993:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:18642:x1871643144286848:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938432.718035:0:17131:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784938432.718038:0:17131:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1784938432.718042:0:17131:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784938432.718388:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:18642:x1871643144286848:12345-0@lo:253:mount.lustre.0 Request processed in 395us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938432.718395:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784938432.718464:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144286848:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784938432.718475:0:18642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784938432.718478:0:18642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938432.718479:0:18642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784938432.718480:0:18642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938432.718481:0:18642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938432.718482:0:18642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938432.718483:0:18642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938432.718484:0:18642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784938432.718485:0:18642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938432.718486:0:18642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784938432.718502:0:18642:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910cdf54e800 from lustre-OST0000 10000000:01000000:3.0:1784938432.718542:0:18642:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784938432.718544:0:18642:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784938432.718563:0:18642:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910bc715b380 local copy 00010000:00010000:3.0:1784938432.718573:0:18642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938432.718654:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144286976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938432.718686:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938432.719423:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938432.719540:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144286976 00000100:00100000:0.0:1784938432.719612:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144286976 00000100:00100000:2.0:1784938432.719891:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784938432.719901:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:18642:x1871643144286976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938432.720004:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:18642:x1871643144286976:12345-0@lo:501:mount.lustre.0 Request processed in 103us (1316us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938432.720021:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784938432.720142:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144286976:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784938432.720160:0:18642:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784938432.720184:0:18642:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784938432.720192:0:18642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938432.720202:0:18642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938432.720266:0:18642:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910cdf54e800 10000000:01000000:0.0:1784938432.720271:0:18642:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784938432.720277:0:18642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784938432.720285:0:18642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938432.720290:0:18642:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784938432.720292:0:18642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784938432.720318:0:18642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938432.720326:0:18642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938432.720335:0:18642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938432.720351:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938432.720810:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938432.720846:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf388e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938432.720890:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144287104 00000100:00100000:3.0:1784938432.720896:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144287104 00000100:00100000:3.0:1784938432.720933:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784938432.720941:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+18:18642:x1871643144287104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938432.720951:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938432.720965:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc97d0e00/0x26783cd1c59ef5e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef5de expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938432.720999:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d0e00/0x26783cd1c59ef5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef5de expref: 19 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938432.721008:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc97d0e00/0x26783cd1c59ef5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef5de expref: 19 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938432.721017:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0e00, rc 0) 00000100:00100000:3.0:1784938432.721159:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287104:12345-0@lo:101:mount.lustre.0 Request processed in 218us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938432.721167:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784938432.721354:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938432.721436:0:18642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef5de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef5e5 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938432.721447:0:18642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef5de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef5e5 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938432.725728:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1784938432.726632:0:18642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938432.728878:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1784938432.728926:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1784938432.728942:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1784938432.728954:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1784938432.728968:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1784938432.728979:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1784938432.729003:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1784938432.729009:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1784938432.729117:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938432.729181:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938432.733078:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfa340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938432.733253:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144287232 00000100:00100000:3.0:1784938432.733264:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144287232 00000100:00100000:3.0:1784938432.733380:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784938432.733389:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938432.733690:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287232:12345-0@lo:501:mount.lustre.0 Request processed in 301us (4507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938432.733698:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784938432.733803:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938432.733853:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938432.733907:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938432.734123:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf388e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938432.734202:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144287360 00000100:00100000:2.0:1784938432.734208:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144287360 00000100:00100000:2.0:1784938432.734252:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784938432.734259:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938432.735089:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287360:12345-0@lo:503:mount.lustre.0 Request processed in 827us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938432.735097:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784938432.735258:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784938432.736140:0:18642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938432.736276:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938432.736328:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938432.736363:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfa34d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938432.736792:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144287488 00000100:00100000:0.0:1784938432.736799:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144287488 00000100:00100000:0.0:1784938432.736839:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784938432.736847:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287488:12345-0@lo:502:mount.lustre.0 00010000:00010000:2.0:1784938432.737204:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938432.737389:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287488:12345-0@lo:502:mount.lustre.0 Request processed in 542us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938432.737396:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784938432.737545:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784938432.737898:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1784938432.737927:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1784938432.737942:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1784938432.737955:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1784938432.737967:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1784938432.737980:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1784938432.737992:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1784938432.738004:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1784938432.738015:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1784938432.738026:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1784938432.738037:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1784938432.738048:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1784938432.738073:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938432.738117:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938432.738156:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfa34d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938432.738242:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144287616 00000100:00100000:0.0:1784938432.738248:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144287616 00000100:00100000:0.0:1784938432.738275:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784938432.738282:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938432.738358:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287616:12345-0@lo:502:mount.lustre.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938432.738484:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784938432.738912:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784938432.738966:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1784938432.738977:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1784938432.739894:0:18659:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938432.739902:0:18659:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1784938432.739909:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938432.739912:0:18659:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1784938432.739918:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938432.739932:0:18659:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff910cf2dc4d40) 00000020:00000080:1.0:1784938432.739954:0:18659:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784938432.739960:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784938432.740042:0:18659:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cdf54e800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1784938432.740050:0:18659:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784938432.740058:0:18659:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x26783cd1c59ef5f3 00010000:00010000:1.0:1784938432.748526:0:18659:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1784938432.749337:0:18659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1784938432.751425:0:18659:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1784938432.753378:0:18659:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784938432.753389:0:18659:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938432.753395:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938432.753397:0:18659:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784938432.753401:0:18659:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784938432.753404:0:18659:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1784938432.753406:0:18659:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938432.753407:0:18659:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938432.753408:0:18659:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784938432.753411:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938432.753412:0:18659:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784938432.753414:0:18659:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938432.753417:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938432.753418:0:18659:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938432.753421:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938432.753423:0:18659:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784938432.753425:0:18659:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938432.753427:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938432.753434:0:18659:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784938432.753438:0:18659:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938432.753440:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938432.753441:0:18659:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784938432.753445:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784938432.753472:0:18659:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938432.753475:0:18659:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938432.753477:0:18659:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784938432.753480:0:18659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1784938432.756483:0:18642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1784938432.756524:0:18642:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784938432.756544:0:18642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef5de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef5e5 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938432.756568:0:18642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77e00/0x26783cd1c59ef5de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef5e5 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938432.756577:0:18642:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cdf54e800 from 1 10000000:01000000:2.0:1784938432.756579:0:18642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938432.756611:0:18642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938432.756623:0:18642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938432.756635:0:18642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938432.756657:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938432.756714:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938432.756770:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfa34d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938432.757605:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144287744 00000100:00100000:1.0:1784938432.757615:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144287744 00000100:00100000:1.0:1784938432.757659:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784938432.757668:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144287744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938432.757683:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938432.757699:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef5fa expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.757720:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef5fa expref: 20 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.758468:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef5fa expref: 20 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.758479:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1600, rc 0) 00000100:00100000:1.0:1784938432.758542:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144287744:12345-0@lo:101:mount.lustre.0 Request processed in 875us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938432.758664:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938432.758682:0:18642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938432.758691:0:18642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938432.759866:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784938432.760134:0:18642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938432.760360:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784938432.760572:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784938432.760590:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784938432.760595:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784938432.760661:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938432.760719:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938432.760890:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc73350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938432.760978:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784938432.761013:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144287872 00000100:00100000:1.0:1784938432.761019:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144287872 00000100:00100000:1.0:1784938432.761050:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784938432.761058:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd583850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144287872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938432.761160:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd583850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144287872:12345-0@lo:501:mount.lustre.0 Request processed in 102us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.761166:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784938432.761263:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144287872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938432.761295:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938432.761338:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938432.761359:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc73350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938432.762701:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144288000 00000100:00100000:1.0:1784938432.762712:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144288000 00000100:00100000:1.0:1784938432.762773:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784938432.762781:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144288000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938432.762908:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144288000:12345-0@lo:503:mount.lustre.0 Request processed in 128us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.762915:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784938432.763491:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288000:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784938432.764591:0:18642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784938432.764676:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938432.764762:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938432.764806:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938432.765094:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144288128 00000100:00100000:2.0:1784938432.765101:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144288128 00000100:00100000:2.0:1784938432.765148:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784938432.765157:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144288128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938432.765300:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144288128:12345-0@lo:502:mount.lustre.0 Request processed in 144us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938432.765308:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784938432.765475:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784938432.765722:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1784938432.768708:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1784938432.768909:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1784938432.768929:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1784938432.768941:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1784938432.768953:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1784938432.768966:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1784938432.768979:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1784938432.768994:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784938432.769008:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1784938432.769033:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1784938432.769081:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938432.769158:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938432.769254:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc6712300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938432.774095:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144288256 00000100:00100000:2.0:1784938432.774110:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144288256 00000100:00100000:2.0:1784938432.774158:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784938432.774168:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144288256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938432.774359:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144288256:12345-0@lo:502:mount.lustre.0 Request processed in 193us (5201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.775303:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938432.775420:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1784938432.775434:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:2.0:1784938432.776066:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000020:01000000:3.0:1784938432.776735:0:18663:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938432.776756:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938432.776758:0:18663:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784938432.776766:0:18663:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cdf54e800 00000020:00000080:3.0:1784938432.776768:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938432.776776:0:18663:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938432.776778:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938432.776779:0:18663:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784938432.776781:0:18663:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938432.776783:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938432.776785:0:18663:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784938432.776788:0:18663:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910cdf54e800 00000020:00000080:3.0:1784938432.776790:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938432.776858:0:18663:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938432.776862:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938432.776864:0:18663:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784938432.776866:0:18663:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938432.776869:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938432.776870:0:18663:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784938432.776874:0:18663:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cdf54e800 00000020:00000080:3.0:1784938432.776876:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938432.776894:0:18663:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938432.776896:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938432.776897:0:18663:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784938432.776899:0:18663:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938432.776901:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938432.776903:0:18663:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784938432.776905:0:18663:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910cdf54e800 00000020:00000080:3.0:1784938432.776907:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938432.776938:0:18663:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938432.776941:0:18663:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938432.776943:0:18663:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784938432.776946:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1784938432.777835:0:18642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1784938432.777869:0:18642:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938432.777892:0:18642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938432.777911:0:18642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938432.777970:0:18642:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784938432.777973:0:18642:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910cdf54e800 10000000:01000000:2.0:1784938432.777976:0:18642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910cdf54e800 10000000:01000000:2.0:1784938432.777980:0:18642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784938432.777986:0:18642:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910cdf54e800 from 1 10000000:01000000:2.0:1784938432.777988:0:18642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938432.778024:0:18642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1200/0x26783cd1c59ef608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938432.778032:0:18642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cffbc1200/0x26783cd1c59ef608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938432.778043:0:18642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cffbc1200/0x26783cd1c59ef608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938432.778065:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938432.778496:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938432.778542:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfa34300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938432.778641:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144288384 00000100:00100000:3.0:1784938432.778648:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144288384 00000100:00100000:3.0:1784938432.778694:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784938432.778702:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:18642:x1871643144288384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938432.778716:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938432.778732:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc97d1400/0x26783cd1c59ef60f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef608 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938432.778769:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d1400/0x26783cd1c59ef60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef608 expref: 21 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938432.778780:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc97d1400/0x26783cd1c59ef60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef608 expref: 21 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938432.778789:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1400, rc 0) 00000100:00100000:3.0:1784938432.789445:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144288384:12345-0@lo:101:mount.lustre.0 Request processed in 10736us (10941us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938432.789459:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784938432.792313:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938432.792343:0:18642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cffbc1200/0x26783cd1c59ef608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef60f expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938432.792357:0:18642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1200/0x26783cd1c59ef608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef60f expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938432.794828:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1784938432.795105:0:18642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938432.795298:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784938432.795324:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784938432.795338:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784938432.796865:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784938432.796906:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784938432.796921:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784938432.796935:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784938432.796949:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784938432.796963:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784938432.796978:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784938432.796991:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784938432.797005:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784938432.797018:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784938432.797031:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784938432.797044:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784938432.797056:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784938432.797066:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784938432.797077:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784938432.797087:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784938432.797115:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784938432.797127:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784938432.797138:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784938432.797148:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784938432.797160:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784938432.797170:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1784938432.797180:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1784938432.797191:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1784938432.797201:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1784938432.797261:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1784938432.799974:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1784938432.800001:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1784938432.800014:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1784938432.800027:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1784938432.800039:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1784938432.800052:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1784938432.800065:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1784938432.800079:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1784938432.800136:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1784938432.800143:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1784938432.801298:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938432.801359:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938432.801399:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc6063300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938432.801679:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144288512 00000100:00100000:3.0:1784938432.801686:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144288512 00000100:00100000:3.0:1784938432.801734:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784938432.801820:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144288512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938432.803765:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144288512:12345-0@lo:501:mount.lustre.0 Request processed in 1938us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938432.803777:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784938432.808503:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938432.809663:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938432.809816:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938432.809914:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc6063300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938432.814896:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144288640 00000100:00100000:3.0:1784938432.814909:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144288640 00000100:00100000:3.0:1784938432.814969:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784938432.814979:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144288640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938432.815136:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144288640:12345-0@lo:503:mount.lustre.0 Request processed in 158us (5319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938432.815144:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784938432.815773:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784938432.816174:0:18642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938432.816299:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938432.816352:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938432.818790:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc6063300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938432.819354:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144288768 00000100:00100000:3.0:1784938432.819423:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144288768 00000100:00100000:3.0:1784938432.819518:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784938432.819528:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144288768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938432.819696:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144288768:12345-0@lo:502:mount.lustre.0 Request processed in 169us (3343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938432.819703:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784938432.825429:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784938432.826297:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784938432.826339:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784938432.826356:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784938432.826371:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784938432.826383:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784938432.826397:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784938432.826411:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784938432.826427:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784938432.826443:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784938432.826460:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784938432.826479:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784938432.826496:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784938432.826523:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784938432.826539:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784938432.826570:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784938432.826586:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784938432.826601:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784938432.826614:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784938432.826626:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784938432.826639:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784938432.828174:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784938432.828193:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784938432.828208:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784938432.828243:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784938432.828258:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1784938432.828274:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1784938432.828290:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1784938432.828303:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1784938432.828315:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1784938432.828328:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1784938432.828359:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1784938432.828375:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1784938432.828389:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1784938432.828403:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1784938432.828418:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1784938432.828432:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1784938432.828445:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1784938432.828455:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1784938432.828467:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1784938432.828480:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1784938432.828493:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1784938432.828508:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1784938432.828523:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1784938432.828537:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1784938432.828551:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1784938432.828576:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1784938432.828609:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1784938432.828626:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1784938432.834489:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938432.834585:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938432.834638:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d01000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938432.834765:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144288896 00000100:00100000:3.0:1784938432.834773:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144288896 00000100:00100000:3.0:1784938432.834828:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784938432.834839:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144288896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938432.834971:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144288896:12345-0@lo:502:mount.lustre.0 Request processed in 134us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938432.834979:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784938432.835152:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144288896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938432.835502:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1784938432.835530:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1784938432.835565:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144289024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938432.835607:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938432.835640:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d01000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938432.835812:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144289024 00000100:00100000:2.0:1784938432.835818:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144289024 00000100:00100000:2.0:1784938432.835851:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784938432.835858:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144289024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938432.835953:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144289024:12345-0@lo:502:mount.lustre.0 Request processed in 95us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938432.835961:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784938432.836258:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144289024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938432.836306:0:18642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1784938432.836315:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1784938432.839168:0:18669:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784938432.839192:0:18669:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff910cfcfb99c0) 00000020:00000080:3.0:1784938432.839629:0:18669:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1784938432.839982:0:18669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cdf54e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784938432.839987:0:18669:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cdf54e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784938432.839990:0:18669:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cdf54e800 3 00010000:00080000:3.0:1784938432.840026:0:18669:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc657c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1784938432.843498:0:18669:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1784938432.844352:0:18669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784938432.844504:0:18669:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938432.844518:0:18669:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x26783cd1c59ef61d 00000100:00080000:3.0:1784938432.844531:0:18669:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:3.0:1784938432.844543:0:18669:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff910bc657c800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938432.844652:0:18669:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb27100 x1871643144289152/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938432.844929:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1871643144289152:192.168.203.126@tcp:38:llog_process_th.0 00000100:00100000:1.0:1784938432.845195:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938432.845261:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144289152 00000100:00100000:1.0:1784938432.845268:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144289152 00000100:00100000:1.0:1784938432.845300:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:1.0:1784938432.845307:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1871643144289152:12345-192.168.203.126@tcp:38:llog_process_th.0 00010000:00080000:1.0:1784938432.845331:0:17141:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:1.0:1784938432.845361:0:17141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x26783cd1c59ef624 00000004:00100000:1.0:1784938432.845384:0:17141:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784938432.845418:0:17141:0:(import.c:65:import_set_state_nolock()) ffff910bc64af800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938432.845466:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1871643144289152:12345-192.168.203.126@tcp:38:llog_process_th.0 Request processed in 157us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.845474:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00080000:3.0:1784938432.845826:0:18669:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784938432.847240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938432.847246:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938432.847249:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938432.847252:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938432.847279:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938432.847282:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938432.847285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938432.847288:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938432.847688:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144289408:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938432.847924:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938432.847932:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144289280:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938432.847973:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144289536:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938432.847995:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938432.848010:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144289664:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938432.848182:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938432.848269:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938432.848295:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144289408 00000100:00100000:2.0:1784938432.848302:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144289408 00000100:00100000:2.0:1784938432.848341:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:2.0:1784938432.848350:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144289408:12345-192.168.203.126@tcp:400:kworker.0 00000020:01000004:3.0:1784938432.848594:0:18669:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784938432.848610:0:18669:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff910cfcfb8000) 00000020:00000080:3.0:1784938432.848632:0:18669:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1784938432.849063:0:18669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910cdf54e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784938432.849068:0:18669:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910cdf54e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784938432.849070:0:18669:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910cdf54e800 3 00010000:00080000:3.0:1784938432.849099:0:18669:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc657f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.126@tcp at head 00000100:00100000:2.0:1784938432.850101:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144289408:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 1746us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938432.850114:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:2.0:1784938432.850158:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144289536 00000100:00100000:2.0:1784938432.850166:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144289536 00000100:00100000:2.0:1784938432.850196:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:2.0:1784938432.850204:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144289536:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938432.850252:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144289536:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 49us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938432.850258:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:2.0:1784938432.851635:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144289536:192.168.203.126@tcp:400:kworker.0 00010000:00010000:3.0:1784938432.852171:0:18669:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1784938432.852285:0:18669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1784938432.852331:0:18669:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938432.852342:0:18669:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x26783cd1c59ef632 00000100:00080000:3.0:1784938432.852350:0:18669:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:3.0:1784938432.852358:0:18669:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff910bc657f800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938432.852653:0:18669:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb26d80 x1871643144289792/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938432.852670:0:18669:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:2.0:1784938432.853055:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cd2070700 x1871643144289408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938432.853070:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144289408:192.168.203.126@tcp:400:kworker.0 00000100:00080000:2.0:1784938432.853185:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938432.853190:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938432.853193:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938432.853201:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938432.853205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938432.853207:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938432.853210:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938432.853234:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784938432.857527:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938432.857652:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938432.857881:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144289280 00000100:00100000:1.0:1784938432.857891:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144289280 00000100:00100000:1.0:1784938432.857937:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:1.0:1784938432.857947:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144289280:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938432.858022:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144289280:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 76us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.858029:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:1.0:1784938432.858208:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144289280:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938432.858259:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144289664 00000100:00100000:1.0:1784938432.858262:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144289664 00000100:00100000:1.0:1784938432.858287:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:1.0:1784938432.858294:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144289664:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938432.858339:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144289664:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 45us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.858347:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00010000:00080000:0.0:1784938432.858906:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cffb27100 x1871643144289152/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938432.858918:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938432.858926:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1784938432.858933:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784938432.858945:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784938432.858948:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc657c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784938432.858955:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1871643144289152:192.168.203.126@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938432.858978:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1871643144289792:192.168.203.126@tcp:38:llog_process_th.0 00000040:00080000:3.0:1784938432.859235:0:18669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1784938432.860472:0:18642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784938432.860508:0:18642:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938432.860532:0:18642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cffbc1200/0x26783cd1c59ef608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef60f expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938432.860544:0:18642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cffbc1200/0x26783cd1c59ef608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef60f expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784938432.860855:0:18642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784938432.860858:0:18642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938432.860859:0:18642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938432.860860:0:18642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938432.860861:0:18642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938432.860863:0:18642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938432.860864:0:18642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938432.860866:0:18642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938432.860867:0:18642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938432.860871:0:18642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1784938432.860873:0:18642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938432.860874:0:18642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938432.860876:0:18642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938432.860877:0:18642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938432.860878:0:18642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938432.860879:0:18642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938432.860880:0:18642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938432.860881:0:18642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938432.860882:0:18642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938432.860905:0:18642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784938432.860921:0:18642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144289920:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784938432.860984:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938432.861021:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144289920 00000100:00100000:0.0:1784938432.861026:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144289920 00000100:00100000:0.0:1784938432.861071:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784938432.861078:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:18642:x1871643144289920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784938432.861103:0:17134:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784938432.861116:0:17134:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784938432.861237:0:18642:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d019c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938432.861967:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00010000:00080000:1.0:1784938432.862006:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cd2070e00 x1871643144289664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938432.862020:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144289664:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938432.862046:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144289792 00000100:00100000:1.0:1784938432.862050:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144289792 00000100:00100000:1.0:1784938432.862075:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:1.0:1784938432.862081:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1871643144289792:12345-192.168.203.126@tcp:38:llog_process_th.0 00010000:00080000:1.0:1784938432.862105:0:17141:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:1.0:1784938432.862139:0:17141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x26783cd1c59ef639 00000004:00100000:1.0:1784938432.862150:0:17141:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784938432.862182:0:17141:0:(import.c:65:import_set_state_nolock()) ffff910bc64a8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938432.865202:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1871643144289792:12345-192.168.203.126@tcp:38:llog_process_th.0 Request processed in 3107us (3225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.865252:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00010000:00080000:1.0:1784938432.867139:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910cffb26d80 x1871643144289792/t0(0) o38->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938432.867154:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938432.867164:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1784938432.867172:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784938432.867178:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784938432.867206:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc657f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784938432.867235:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1871643144289792:192.168.203.126@tcp:38:llog_process_th.0 20000000:01000000:0.0:1784938432.870864:0:17134:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784938432.870881:0:17134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784938432.872759:0:17155:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784938432.872768:0:17155:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784938432.872791:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.872809:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef583 expref: 21 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.872818:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef591 expref: 21 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.872824:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.872866:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef591 expref: 21 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.872880:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef591 expref: 21 pid: 17131 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938432.872894:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144290048:0@lo:104: 00000100:00100000:1.0:1784938432.872956:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784938432.873002:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef583 expref: 21 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873010:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef583 expref: 21 pid: 17134 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938432.873032:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144290176:0@lo:104: 00000100:00100000:1.0:1784938432.873059:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938432.873076:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc40a0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938432.873102:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784938432.873121:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144290048 00000100:00100000:1.0:1784938432.873127:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144290048 00000100:00100000:1.0:1784938432.873163:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144290176 00000100:00100000:1.0:1784938432.873166:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144290176 00000100:00100000:1.0:1784938432.873180:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938432.873188:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:17155:x1871643144290048:12345-0@lo:104: 00010000:00010000:1.0:1784938432.873201:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873290:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938432.873297:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:17155:x1871643144290048:12345-0@lo:104: Request processed in 110us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.873304:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938432.873321:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938432.873327:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910ce6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:17155:x1871643144290176:12345-0@lo:104: 00010000:00010000:1.0:1784938432.873335:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873365:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784938432.873371:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910ce6b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:17155:x1871643144290176:12345-0@lo:104: Request processed in 44us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.873376:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938432.873428:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144290048:0@lo:104: 00000100:00100000:1.0:1784938432.873445:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144290176:0@lo:104: 00010000:00010000:1.0:1784938432.873462:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873477:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938432.873482:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873489:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1000 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:1.0:1784938432.873493:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873502:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938432.873508:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938432.873513:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938432.873540:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873547:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938432.873564:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873571:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cffbc1000/0x26783cd1c59ef591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef598 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873582:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938432.873591:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873597:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1c00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:1.0:1784938432.873600:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873606:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938432.873612:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938432.873617:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938432.873629:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873635:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938432.873640:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873646:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cffbc1c00/0x26783cd1c59ef583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef58a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873658:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938432.873660:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938432.873661:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938432.873667:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938432.873683:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144290304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938432.873709:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938432.873753:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938432.873759:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144290432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938432.873782:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938432.873812:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144290304 00000100:00100000:1.0:1784938432.873815:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144290304 00010000:00010000:1.0:1784938432.873830:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef591 expref: 22 pid: 17131 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938432.873848:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144290432 00000100:00100000:1.0:1784938432.873851:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144290432 00010000:00010000:1.0:1784938432.873861:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef583 expref: 23 pid: 17134 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938432.873877:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938432.873883:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:3642:x1871643144290304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938432.873892:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938432.873896:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef591 expref: 23 pid: 17131 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873906:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef591 expref: 23 pid: 17131 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873920:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc97d1e00/0x26783cd1c59ef598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef591 expref: 23 pid: 17131 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.873932:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938432.873958:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:3642:x1871643144290304:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.873965:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938432.873976:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938432.873987:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc676a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3642:x1871643144290432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938432.873994:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938432.873999:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef583 expref: 21 pid: 17134 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874006:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef583 expref: 21 pid: 17134 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874015:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76400/0x26783cd1c59ef58a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef583 expref: 21 pid: 17134 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874027:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874036:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938432.874047:0:17124:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006782271s 00010000:00010000:1.0:1784938432.874052:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874059:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874066:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874072:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874077:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0400 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938432.874086:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874094:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874106:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874115:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938432.874138:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc676a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:3642:x1871643144290432:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938432.874144:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938432.874192:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144290432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938432.874199:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144290304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938432.874234:0:17155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874241:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938432.874247:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef640 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938432.875136:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:18642:x1871643144289920:12345-0@lo:253:mount.lustre.0 Request processed in 14053us (14146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938432.875147:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784938432.875579:0:18642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:18642:1871643144289920:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784938432.875592:0:18642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784938432.875595:0:18642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938432.875597:0:18642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938432.875598:0:18642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938432.875607:0:18642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938432.875608:0:18642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938432.875609:0:18642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938432.875611:0:18642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938432.875613:0:18642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938432.875614:0:18642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784938432.875628:0:18642:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1784938432.880408:0:18642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1784938432.883190:0:18642:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1784938432.883200:0:18642:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1784938432.883483:0:18642:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784938432.883524:0:18642:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784938432.883544:0:18642:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784938432.883630:0:18642:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1784938432.884914:0:18642:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784938432.885116:0:18642:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784938433.183814:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938433.183839:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144290560:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938433.184039:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938433.184074:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144290560 00000100:00100000:3.0:1784938433.184081:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144290560 00000100:00100000:3.0:1784938433.184122:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:3.0:1784938433.184130:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144290560:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938433.184161:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784938433.184194:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144290560:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938433.184201:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:0.0:1784938433.185630:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144290688:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938433.185718:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144290560:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938433.185821:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938433.185847:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144290688 00000100:00100000:0.0:1784938433.185854:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144290688 00000100:00100000:0.0:1784938433.185898:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:0.0:1784938433.185907:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144290688:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938433.185938:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784938433.185980:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144290688:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 73us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938433.185989:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:0.0:1784938433.186065:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144290688:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:2.0:1784938433.763056:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784938434.122015:0:18723:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938434.122926:0:18723:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1784938434.595889:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784938434.595900:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910bc7112800 from 9 10000000:01000000:3.0:1784938434.595907:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784938434.595977:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938434.595992:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938434.596005:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938434.596057:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144290816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938434.596157:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938434.596256:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019cecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938434.596439:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144290816 00000100:00100000:2.0:1784938434.596449:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144290816 00000100:00100000:2.0:1784938434.596510:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784938434.596521:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+19:17136:x1871643144290816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938434.596538:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938434.596557:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef647 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938434.596586:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef647 expref: 20 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938434.596597:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef647 expref: 20 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938434.596619:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1c00, rc 0) 00000100:00100000:2.0:1784938434.596683:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:17136:x1871643144290816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938434.596690:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784938434.596761:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144290816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938434.596780:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938434.596789:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938434.596861:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144290944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784938434.596897:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938434.596920:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144290944 00000100:00100000:2.0:1784938434.596924:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910ccca5f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938434.597008:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144290944 00000100:00100000:0.0:1784938434.597094:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784938434.597103:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:17136:x1871643144290944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784938434.597123:0:17133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784938434.597144:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784938434.597147:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1784938434.597298:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:17136:x1871643144290944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 196us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938434.597307:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784938434.597390:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144290944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784938434.597461:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938434.597470:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938434.597479:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938434.597489:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784938434.597492:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cc871e000 from 9 10000000:01000000:3.0:1784938434.597495:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784938434.597522:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938434.597530:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938434.597538:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938434.597552:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144291072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938434.597586:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938434.597678:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019cec00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938434.598178:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144291072 00000100:00100000:2.0:1784938434.598186:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144291072 00000100:00100000:2.0:1784938434.598271:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784938434.598282:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:17136:x1871643144291072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938434.598295:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938434.598311:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef655 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938434.598334:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef655 expref: 21 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938434.598346:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef655 expref: 21 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938434.598362:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1000, rc 0) 00000100:00100000:2.0:1784938434.598416:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:17136:x1871643144291072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938434.598423:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784938434.598587:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144291072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938434.598616:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938434.598626:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938434.598679:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144291200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784938434.598720:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938434.598823:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019cec00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938434.598910:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144291200 00000100:00100000:1.0:1784938434.598916:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144291200 00000100:00100000:1.0:1784938434.598955:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784938434.598962:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:17136:x1871643144291200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784938434.598980:0:17133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938434.599001:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938434.599004:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1784938434.599093:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:17136:x1871643144291200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938434.599100:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784938434.599137:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144291200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784938434.599229:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938434.599239:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938434.599248:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938434.785027:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938435.808903:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784938436.319887:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784938436.831478:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938437.857664:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938438.305468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938438.305475:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784938438.305478:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938438.305482:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784938438.305506:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938438.305509:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784938438.305511:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938438.305514:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938438.305571:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144291712:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938438.305654:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144292224:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938438.305698:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784938438.305726:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144291584:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938438.305755:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144292096:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938438.305938:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938438.306019:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938438.306038:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938438.306059:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938438.306084:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144291712 00000100:00100000:0.0:1784938438.306090:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144291712 00000100:00100000:0.0:1784938438.306126:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144292224 00000100:00100000:0.0:1784938438.306128:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144292224 00000100:00100000:0.0:1784938438.306142:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:0.0:1784938438.306148:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144291712:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.306352:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144291328:0@lo:400:kworker.0 00000100:00100000:1.0:1784938438.306392:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938438.306428:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144291840:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.306462:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144292352:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938438.306489:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784938438.306494:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144291456:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.306516:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144291968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.306557:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144291584 00000100:00100000:1.0:1784938438.306561:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144291584 00000100:00100000:1.0:1784938438.306588:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144292096 00000100:00100000:1.0:1784938438.306591:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144292096 00000100:00100000:1.0:1784938438.306616:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:1.0:1784938438.306623:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144291584:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.306662:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144291584:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 39us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938438.306670:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:1.0:1784938438.306687:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:1.0:1784938438.306694:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144292096:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.306731:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144292096:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938438.306736:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:1.0:1784938438.306755:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144291328 00000100:00100000:1.0:1784938438.306758:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144291328 00000100:00100000:1.0:1784938438.306781:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784938438.306787:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3642:x1871643144291328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938438.306824:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3642:x1871643144291328:12345-0@lo:400:kworker.0 Request processed in 37us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938438.306837:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784938438.306986:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938438.307046:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938438.307060:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938438.307074:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938438.307120:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144291840 00000100:00100000:1.0:1784938438.307124:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144291840 00000100:00100000:1.0:1784938438.307140:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144291968 00000100:00100000:1.0:1784938438.307143:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144291968 00000100:00100000:1.0:1784938438.307158:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:1.0:1784938438.309433:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144291840:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.309522:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144291840:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 2357us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938438.309532:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:1.0:1784938438.309563:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:1.0:1784938438.309572:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144291968:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.309603:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144291968:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (2527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938438.309608:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 13 00010000:00080000:1.0:1784938438.309868:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffbfe680 x1871643144291968/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938438.309886:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144291968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.309901:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144291328:0@lo:400:kworker.0 00010000:00080000:1.0:1784938438.309912:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffbfd500 x1871643144291840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938438.309931:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144291840:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938438.309980:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffbfdc00 x1871643144291584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938438.309990:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144291584:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938438.310004:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffbfed80 x1871643144292096/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938438.310011:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144292096:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938438.310406:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144291712:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 4255us (4467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938438.310416:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:0.0:1784938438.310434:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144292352 00000100:00100000:0.0:1784938438.310441:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144292352 00000100:00100000:0.0:1784938438.310461:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144291456 00000100:00100000:0.0:1784938438.310464:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144291456 00000100:00100000:0.0:1784938438.310478:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:0.0:1784938438.310485:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144292224:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938438.310515:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784938438.310544:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144292224:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 60us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938438.310550:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:0.0:1784938438.310561:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:0.0:1784938438.310575:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144292352:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938438.310593:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784938438.310615:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144292352:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 41us (3569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938438.310620:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:0.0:1784938438.310631:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00100000:0.0:1784938438.310636:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144291456:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938438.310657:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144291456:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (3597us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938438.310662:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00080000:0.0:1784938438.310713:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938438.310717:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938438.311456:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144291712:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.311475:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144292224:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938438.311508:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144291456:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938438.311520:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144292352:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:1.0:1784938438.879539:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938439.270780:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784938439.904619:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938439.968022:0:19013:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784938440.932377:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784938441.019718:0:19065:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938441.019958:0:19065:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784938441.957831:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938442.079343:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938427/real 1784938427] req@ffff910cffbff480 x1871643144285312/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938442 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938442.079390:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910cffbff480 x1871643144285312/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938442 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938442.079410:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938427/real 1784938427] req@ffff910cffbfdf80 x1871643144285440/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938442 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938442.079423:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910cffbfdf80 x1871643144285440/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938442 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938442.079442:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdfb54000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938442.079470:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:3.0:1784938442.079475:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144285312:192.168.203.126@tcp:8:kworker.0 00000100:00080000:3.0:1784938442.079481:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938442.079487:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:3.0:1784938442.079509:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144285440:192.168.203.126@tcp:8:kworker.0 00000100:00080000:1.0:1784938442.079707:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938442.079712:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938442.079715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938442.079718:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784938442.079726:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938442.079758:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144292608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.080101:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144292736:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.080186:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.080285:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144292608 00000100:00100000:0.0:1784938442.080292:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144292608 00000100:00100000:0.0:1784938442.080338:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 29 00000100:00100000:0.0:1784938442.080347:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144292608:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.080402:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144292608:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 50us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.080410:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 29 00000100:00080000:0.0:1784938442.080478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938442.080481:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784938442.080491:0:8:0:(import.c:65:import_set_state_nolock()) ffff910cdfb54000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938442.080496:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 495 00000100:00080000:0.0:1784938442.080502:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784938442.080506:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff910cdfb54000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938442.080529:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfd180 x1871643144292992/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938442.080544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938442.080548:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784938442.080549:0:8:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784938442.080553:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 495 00000100:00080000:0.0:1784938442.080556:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784938442.080559:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff910cdf495800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:0.0:1784938442.080570:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144292992:192.168.203.126@tcp:8:kworker.0 00000100:00100000:0.0:1784938442.080629:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffbfe300 x1871643144293120/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938442.080648:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144293120:192.168.203.126@tcp:8:kworker.0 00000100:00100000:0.0:1784938442.080718:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144293376:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.080775:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144293504:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938442.080947:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144292480:0@lo:400:kworker.0 00000100:00100000:2.0:1784938442.081004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938442.081031:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144293248:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938442.081058:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938442.081064:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144292864:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.081408:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144292480 00000100:00100000:0.0:1784938442.081415:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144292480 00000100:00100000:0.0:1784938442.081454:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784938442.081460:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3643:x1871643144292480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938442.081602:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3643:x1871643144292480:12345-0@lo:400:kworker.0 Request processed in 140us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.081617:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784938442.081735:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.081806:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.081876:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.081893:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.081909:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.081924:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.081939:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.081957:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144292736 00000100:00100000:1.0:1784938442.082486:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144293504 00000100:00100000:1.0:1784938442.082494:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144293504 00000100:00100000:1.0:1784938442.082550:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144293376 00000100:00100000:1.0:1784938442.082554:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144293376 00000100:00100000:1.0:1784938442.082567:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144293248 00000100:00100000:1.0:1784938442.082569:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144293248 00000100:00100000:1.0:1784938442.082584:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:1.0:1784938442.082591:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144293504:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.082643:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144293504:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 52us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.082650:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:1.0:1784938442.082665:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:1.0:1784938442.082671:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144293376:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.082712:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144293376:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 40us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.082718:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:1.0:1784938442.082740:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:1.0:1784938442.082747:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144293248:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.082769:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144293248:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.082775:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00080000:3.0:1784938442.083269:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938442.083274:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784938442.083336:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144292736 00000100:00100000:0.0:1784938442.083378:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:0.0:1784938442.083386:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144292736:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938442.083434:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144292736:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 50us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.083441:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:0.0:1784938442.083466:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144292992 00000100:00100000:0.0:1784938442.083471:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144292992 00000100:00100000:0.0:1784938442.083485:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144293120 00000100:00100000:0.0:1784938442.083488:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144293120 00000100:00100000:0.0:1784938442.083498:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:0.0:1784938442.083502:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1871643144292992:12345-192.168.203.126@tcp:8:kworker.0 00010000:00080000:1.0:1784938442.083637:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffbfd500 x1871643144293504/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938442.083652:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144293504:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.083851:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144292608:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938442.083898:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144292864 00000100:00100000:1.0:1784938442.083902:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144292864 00000100:00100000:1.0:1784938442.083951:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00100000:1.0:1784938442.083958:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144292864:12345-192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938442.084473:0:18648:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1784938442.084503:0:18648:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ef663 00002000:00100000:0.0:1784938442.084514:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff910cdf496000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1784938442.084528:0:18648:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1784938442.084538:0:18648:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784938442.084712:0:18648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1784938442.084945:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144292864:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 987us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.084953:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 30 00010000:00080000:1.0:1784938442.085644:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffbfdf80 x1871643144292736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938442.085657:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144292736:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938442.085725:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffbfdc00 x1871643144293376/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938442.085746:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144293376:192.168.203.126@tcp:400:kworker.0 00000100:00080000:1.0:1784938442.087104:0:18648:0:(import.c:65:import_set_state_nolock()) ffff910cdf493000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938442.087186:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1871643144292992:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 3679us (5307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.087201:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:1.0:1784938442.087667:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:1.0:1784938442.087675:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1871643144293120:12345-192.168.203.126@tcp:8:kworker.0 00010000:00020000:1.0:1784938442.087804:0:18648:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.203.126@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1784938442.089331:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffbfd180 x1871643144292992/t0(0) o8->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938442.089347:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938442.089357:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1784938442.089366:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938442.089372:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784938442.089375:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdfb54000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938442.089395:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938442.090045:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144292992:192.168.203.126@tcp:8:kworker.0 00000004:00080000:0.0:1784938442.090083:0:17880:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938442.090174:0:17880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 510121958589ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784938442.090180:0:17880:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1784938442.092422:0:17881:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1784938442.092454:0:17881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1871643144293760:192.168.203.126@tcp:7:osp-pre-0-1.0 00000100:00100000:0.0:1784938442.092663:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144293632:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938442.092867:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938442.093044:0:17881:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019cee40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938442.093073:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144293632 00000100:00100000:3.0:1784938442.093080:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144293632 00000100:00100000:3.0:1784938442.093130:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:3.0:1784938442.093139:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144293632:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938442.093164:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784938442.093200:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144293632:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 62us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938442.093207:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00080000:3.0:1784938442.093247:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938442.094381:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.094616:0:18649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1784938442.094624:0:18649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784938442.096307:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144292480:0@lo:400:kworker.0 00010000:00080000:2.0:1784938442.096327:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffbfed80 x1871643144293248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938442.096339:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144293248:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938442.096367:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144292864:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938442.096607:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb27800 x1871643144293632/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938442.096630:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144293632:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938442.096703:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144293760 00000100:00100000:0.0:1784938442.096711:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144293760 00000100:00100000:0.0:1784938442.096835:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:0.0:1784938442.096845:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17881:x1871643144293760:12345-192.168.203.126@tcp:7:osp-pre-0-1.0 00000004:00080000:3.0:1784938442.102555:0:17871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1784938442.118209:0:19096:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1784938442.118251:0:19096:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1784938442.118351:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17881:x1871643144293760:12345-192.168.203.126@tcp:7:osp-pre-0-1.0 Request processed in 21501us (23966us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938442.118366:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00010000:00080000:3.0:1784938442.119649:0:17881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb24000 x1871643144293760/t0(0) o7->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938458 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938442.119667:0:17881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1871643144293760:192.168.203.126@tcp:7:osp-pre-0-1.0 00000004:00080000:3.0:1784938442.119693:0:17881:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1784938442.119734:0:17881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1871643144293888:192.168.203.126@tcp:5:osp-pre-0-1.0 00000100:00100000:3.0:1784938442.119784:0:17881:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019cee40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.120188:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.120242:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144293888 00000100:00100000:0.0:1784938442.120249:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144293888 00000100:00100000:0.0:1784938442.120292:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:0.0:1784938442.120302:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17881:x1871643144293888:12345-192.168.203.126@tcp:5:osp-pre-0-1.0 00002000:00080000:0.0:1784938442.120329:0:18649:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1784938442.120365:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17881:x1871643144293888:12345-192.168.203.126@tcp:5:osp-pre-0-1.0 Request processed in 65us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938442.120372:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00010000:00080000:3.0:1784938442.126658:0:17881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb24000 x1871643144293888/t0(0) o5->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938458 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938442.126702:0:17881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1871643144293888:192.168.203.126@tcp:5:osp-pre-0-1.0 00000004:00080000:3.0:1784938442.126719:0:17881:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1784938442.126765:0:17881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1871643144294016:192.168.203.126@tcp:5:osp-pre-0-1.0 00000100:00100000:3.0:1784938442.126834:0:17881:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019cee40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938442.130460:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938442.130495:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144294016 00000100:00100000:0.0:1784938442.130503:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144294016 00000100:00100000:0.0:1784938442.130562:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:0.0:1784938442.130572:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17881:x1871643144294016:12345-192.168.203.126@tcp:5:osp-pre-0-1.0 00002000:00080000:0.0:1784938442.130620:0:19096:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1784938442.155044:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1871643144293120:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 67347us (73127us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938442.155069:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00080000:0.0:1784938442.159501:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784938442.159513:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:0.0:1784938442.159518:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144293120:192.168.203.126@tcp:8:kworker.0 00000001:00080000:2.0:1784938442.181530:0:18643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1784938442.181545:0:18643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1784938442.184782:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17881:x1871643144294016:12345-192.168.203.126@tcp:5:osp-pre-0-1.0 Request processed in 54201us (54320us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784938442.184795:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00010000:00080000:1.0:1784938442.185983:0:17881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb24000 x1871643144294016/t0(0) o5->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938442.186005:0:17881:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1784938442.186013:0:17881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb24000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1871643144294016:192.168.203.126@tcp:5:osp-pre-0-1.0 00000004:00080000:1.0:1784938442.186031:0:17881:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1784938442.186082:0:17881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17881:1871643144294144:192.168.203.126@tcp:900:osp-pre-0-1.0 00000100:00100000:1.0:1784938442.186138:0:17881:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd58d540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938442.186256:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938442.186288:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144294144 00000100:00100000:1.0:1784938442.186294:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144294144 00000100:00100000:1.0:1784938442.186336:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:1.0:1784938442.186344:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17881:x1871643144294144:12345-192.168.203.126@tcp:900:osp-pre-0-1.0 00000100:00100000:1.0:1784938442.186389:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17881:x1871643144294144:12345-192.168.203.126@tcp:900:osp-pre-0-1.0 Request processed in 46us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938442.186397:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00010000:00080000:1.0:1784938442.186505:0:17881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb66300 x1871643144294144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:29/10 lens 264/248 e 0 to 0 dl 1784938458 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938442.186517:0:17881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17881:1871643144294144:192.168.203.126@tcp:900:osp-pre-0-1.0 00000020:00000004:0.0:1784938442.346537:0:19116:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784938442.346790:0:19116:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784938443.006329:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938443.431201:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938443.431871:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144294400:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938443.432270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938443.432312:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144294400 00000100:00100000:3.0:1784938443.432321:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144294400 00000100:00100000:3.0:1784938443.432385:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:3.0:1784938443.432396:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144294400:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938443.432444:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784938443.432496:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144294400:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 102us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.432504:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:1.0:1784938443.432749:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144294272:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938443.435196:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938443.435264:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144294272 00000100:00100000:3.0:1784938443.435275:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144294272 00000100:00100000:3.0:1784938443.435335:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:3.0:1784938443.435346:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144294272:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938443.435394:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784938443.435462:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144294272:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 117us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938443.435470:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:3.0:1784938443.440418:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144294272:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:3.0:1784938443.440499:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144294400:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:2.0:1784938444.064996:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938445.088560:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938446.111373:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784938446.560060:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784938447.144816:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938447.520064:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938447.520092:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144294528:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938447.520426:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938447.520481:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938447.520494:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144294784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.521182:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938447.521282:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938447.521789:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144294656:0@lo:400:kworker.0 00000100:00100000:0.0:1784938447.521860:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938447.521962:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144294656 00000100:00100000:1.0:1784938447.521978:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144294656 00000100:00100000:1.0:1784938447.522031:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784938447.522040:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3643:x1871643144294656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938447.522105:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3643:x1871643144294656:12345-0@lo:400:kworker.0 Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.522113:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784938447.522291:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144294656:0@lo:400:kworker.0 00000100:00100000:2.0:1784938447.522782:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144294528 00000100:00100000:2.0:1784938447.522789:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144294528 00000100:00100000:2.0:1784938447.522850:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:2.0:1784938447.522859:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144294528:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938447.522886:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784938447.522938:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144294528:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 79us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938447.522944:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00080000:0.0:1784938447.523258:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938447.523404:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938447.523410:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784938447.523413:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938447.523416:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938447.523533:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938447.523976:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144295040:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938447.524047:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144294912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938447.524396:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938447.524424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938447.524489:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144294784 00000100:00100000:0.0:1784938447.524495:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144294784 00000100:00100000:0.0:1784938447.524531:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144295040 00000100:00100000:0.0:1784938447.524534:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144295040 00000100:00100000:0.0:1784938447.524562:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:0.0:1784938447.524570:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144294784:12345-192.168.203.126@tcp:400:kworker.0 00000100:00080000:3.0:1784938447.524788:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938447.524793:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784938447.524798:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938447.524804:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 510 00000100:00080000:3.0:1784938447.524811:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784938447.524816:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff910cdf495800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938447.524843:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb25c00 x1871643144295168/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938447.524912:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00100000:3.0:1784938447.524920:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144295040:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938447.525161:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144294784:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 590us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938447.525170:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:3.0:1784938447.525347:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144295040:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 426us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938447.525354:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00100000:3.0:1784938447.525381:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144295552:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938447.525465:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb65880 x1871643144294528/t0(0) o13->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938447.525498:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144294528:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938447.525533:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144295296:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938447.525575:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938447.525583:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144295424:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938447.526158:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938447.526180:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938447.526201:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938447.526325:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144295168:192.168.203.126@tcp:8:kworker.0 00000100:00100000:1.0:1784938447.526545:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938447.530052:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144294912 00000100:00100000:1.0:1784938447.530068:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144294912 00000100:00100000:1.0:1784938447.530122:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144295552 00000100:00100000:1.0:1784938447.530126:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144295552 00000100:00100000:1.0:1784938447.530162:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144295296 00000100:00100000:1.0:1784938447.530166:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144295296 00000100:00100000:1.0:1784938447.530176:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144295424 00000100:00100000:1.0:1784938447.530178:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144295424 00000100:00100000:1.0:1784938447.530196:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:1.0:1784938447.530206:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144294912:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938447.530362:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1871643144294912:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 156us (5935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.530370:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:1.0:1784938447.530390:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:1.0:1784938447.530396:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144295552:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938447.530422:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144295552:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (4265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.530427:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:1.0:1784938447.530439:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:1.0:1784938447.530444:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144295296:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938447.530486:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144295296:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 41us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.530492:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:1.0:1784938447.530503:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:1.0:1784938447.530509:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144295424:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938447.530531:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144295424:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (4329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938447.530536:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00080000:1.0:1784938447.530627:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938447.530631:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938447.531030:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144295168 00000100:00100000:3.0:1784938447.531037:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144295168 00000100:00100000:3.0:1784938447.531064:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:3.0:1784938447.531070:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1871643144295168:12345-192.168.203.126@tcp:8:kworker.0 00010000:00020000:3.0:1784938447.531090:0:18646:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.203.126@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1784938447.531453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc77c5500 x1871643144295552/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938447.531469:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144295552:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938447.548436:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc77c4380 x1871643144295424/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938447.548455:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144295424:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938447.548468:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc77c6680 x1871643144295296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938447.548478:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144295296:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938447.548493:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144294784:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938447.548538:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144295040:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938447.548634:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb26d80 x1871643144294912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938447.548727:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1871643144294912:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938447.549063:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1871643144295168:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 17990us (22516us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938447.549074:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00080000:2.0:1784938447.549618:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938447.549626:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:2.0:1784938447.549630:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144295168:192.168.203.126@tcp:8:kworker.0 00010000:00010000:1.0:1784938448.169175:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938448.546957:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938448.546977:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144295680:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938448.547300:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938448.547345:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144295680 00000100:00100000:2.0:1784938448.547352:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144295680 00000100:00100000:2.0:1784938448.547398:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 35 00000100:00100000:2.0:1784938448.547408:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144295680:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938448.547445:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784938448.547490:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144295680:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938448.547497:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 35 00000100:00100000:2.0:1784938448.547649:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144295680:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938448.548120:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938448.548135:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144295808:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938448.548319:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938448.548382:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144295808 00000100:00100000:3.0:1784938448.548388:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144295808 00000100:00100000:3.0:1784938448.548428:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:3.0:1784938448.548436:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144295808:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938448.548459:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784938448.548494:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144295808:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 58us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938448.548500:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:3.0:1784938448.548604:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144295808:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:1.0:1784938449.184541:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784938449.508879:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784938449.578938:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938429/real 1784938429] req@ffff910bc678df80 x1871643144286208/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938449 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938449.578977:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910bc678df80 x1871643144286208/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938449 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938449.578989:0:3639:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938429/real 1784938429] req@ffff910bc678f480 x1871643144286336/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938449 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938449.579027:0:3639:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910bc678f480 x1871643144286336/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938449 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938449.579046:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc9069000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938449.579069:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:3.0:1784938449.579081:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144286208:192.168.203.126@tcp:8:kworker.0 00000100:00080000:3.0:1784938449.579088:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938449.579094:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-110) 00000100:00100000:3.0:1784938449.579097:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144286336:192.168.203.126@tcp:8:kworker.0 00000100:00080000:2.0:1784938449.579405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938449.579410:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784938449.579413:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cc9069000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938449.579419:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 497 00000100:00080000:2.0:1784938449.579428:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784938449.579435:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff910cc9069000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938449.579456:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cfd5dfb80 x1871643144296192/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938449.579468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938449.579471:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784938449.579473:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938449.579476:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 497 00000100:00080000:2.0:1784938449.579480:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784938449.579483:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910cc487f000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938449.579505:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cfd5df480 x1871643144296320/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784938449.579535:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938449.579537:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784938449.579539:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938449.579543:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 515 00000100:00080000:2.0:1784938449.579547:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784938449.579550:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff910cdf495800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938449.579561:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cfd5ddf80 x1871643144296832/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938449.579601:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144296064:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938449.579791:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144296960:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938449.579822:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784938449.579828:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144296448:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938449.579848:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144297088:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938449.579943:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144295936:0@lo:400:kworker.0 00000100:00100000:3.0:1784938449.579991:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938449.580239:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144295936 00000100:00100000:2.0:1784938449.580246:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144295936 00000100:00100000:2.0:1784938449.580292:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784938449.580300:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3643:x1871643144295936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938449.580349:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3643:x1871643144295936:12345-0@lo:400:kworker.0 Request processed in 49us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938449.580356:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784938449.580390:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144296576:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938449.580458:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144295936:0@lo:400:kworker.0 00000100:00100000:3.0:1784938449.580467:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144296704:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938449.581013:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.581126:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.581160:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.581186:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938449.581198:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144296064 00000100:00100000:2.0:1784938449.581203:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144296064 00000100:00100000:2.0:1784938449.581255:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:2.0:1784938449.581263:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144296064:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938449.581306:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144296064:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 44us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938449.581313:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:2.0:1784938449.582501:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144296960 00000100:00100000:2.0:1784938449.582512:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144296960 00000100:00100000:2.0:1784938449.582552:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144297088 00000100:00100000:2.0:1784938449.582556:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144297088 00000100:00100000:2.0:1784938449.582585:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:2.0:1784938449.582593:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144296960:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938449.583013:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784938449.583023:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784938449.583068:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.583087:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.583131:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144296576 00000100:00100000:3.0:1784938449.583135:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144296576 00000100:00100000:3.0:1784938449.583165:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:3.0:1784938449.583173:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144296576:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938449.583264:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144296576:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 92us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938449.583271:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:3.0:1784938449.583292:0:17140:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784938449.583297:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144296448 00000100:00100000:3.0:1784938449.583300:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144296448 00000100:00100000:3.0:1784938449.583314:0:17140:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784938449.583320:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:3.0:1784938449.583326:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144297088:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938449.583349:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144297088:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938449.583369:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:3.0:1784938449.583390:0:17140:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784938449.583397:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:3.0:1784938449.583402:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144296448:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938449.583494:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144296960:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 900us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938449.583502:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00080000:2.0:1784938449.583522:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938449.583538:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144296192:192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938449.583590:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144296320:192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938449.583616:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144296832:192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938449.586793:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144296064:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938449.586935:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144296448:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 3529us (3865us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938449.586947:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:3.0:1784938449.587186:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.587330:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.587349:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.590038:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144296704 00000100:00100000:3.0:1784938449.590053:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144296704 00000100:00100000:3.0:1784938449.590113:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144296832 00000100:00100000:3.0:1784938449.590116:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144296832 00000100:00100000:3.0:1784938449.590124:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144296192 00000100:00100000:3.0:1784938449.590127:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144296192 00000100:00100000:3.0:1784938449.590151:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144296320 00000100:00100000:3.0:1784938449.590154:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144296320 00000100:00100000:3.0:1784938449.590169:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:3.0:1784938449.590180:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144296704:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938449.590277:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144296704:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 98us (9089us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938449.590285:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 0 00000100:00100000:3.0:1784938449.590302:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:3.0:1784938449.590306:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1871643144296832:12345-192.168.203.126@tcp:8:kworker.0 00010000:00020000:3.0:1784938449.590326:0:18649:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.203.126@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938449.590362:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1871643144296832:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 43us (3165us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938449.590369:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:3.0:1784938449.590387:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:3.0:1784938449.590391:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1871643144296192:12345-192.168.203.126@tcp:8:kworker.0 00010000:00080000:3.0:1784938449.590410:0:18649:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:3.0:1784938449.590446:0:18649:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ef66a 00002000:00100000:3.0:1784938449.590457:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff910bc657b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784938449.590460:0:18649:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784938449.590463:0:18649:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784938449.590534:0:18649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784938449.590557:0:18649:0:(import.c:65:import_set_state_nolock()) ffff910bc657e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938449.590584:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1871643144296192:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 191us (3254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938449.590590:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:3.0:1784938449.590607:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:3.0:1784938449.590612:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1871643144296320:12345-192.168.203.126@tcp:8:kworker.0 00010000:00020000:3.0:1784938449.590622:0:18649:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.203.126@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938449.590654:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1871643144296320:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 41us (3304us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784938449.590660:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00010000:00080000:3.0:1784938449.590714:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd5dd180 x1871643144296448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938449.590730:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144296448:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938449.590745:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd5ded80 x1871643144297088/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938449.590754:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144297088:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938449.590766:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd5dca80 x1871643144296960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938449.590774:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144296960:192.168.203.126@tcp:400:kworker.0 00000100:00080000:2.0:1784938449.590926:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938449.591026:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd5dd500 x1871643144296704/t0(0) o400->lustre-OST0000-osc-MDT0001@192.168.203.126@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938449.591037:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144296704:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938449.591055:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd5dfb80 x1871643144296192/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938449.591064:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938449.591071:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784938449.591079:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784938449.591084:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784938449.591087:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc9069000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784938449.591106:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784938449.591118:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144296192:192.168.203.126@tcp:8:kworker.0 00000100:00080000:3.0:1784938449.591133:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938449.591137:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:3.0:1784938449.591140:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144296320:192.168.203.126@tcp:8:kworker.0 00000100:00080000:3.0:1784938449.591154:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938449.591158:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-19) 00000100:00100000:3.0:1784938449.591160:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144296832:192.168.203.126@tcp:8:kworker.0 00000004:00080000:2.0:1784938449.591180:0:17164:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1784938449.591200:0:17164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17164:1871643144297472:192.168.203.126@tcp:5:osp-pre-0-0.0 00000100:00100000:2.0:1784938449.591274:0:17164:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc2a679c0 going to sleep for 11 seconds 00000004:00080000:2.0:1784938449.591291:0:17163:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784938449.591365:0:17163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 517623150345ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784938449.591373:0:17163:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784938449.591397:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144297344:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938449.592926:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.592961:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938449.593014:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144296576:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938449.593027:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144297216:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938449.593130:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144297472 00000100:00100000:1.0:1784938449.593137:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144297472 00000100:00100000:3.0:1784938449.593168:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144297344 00000100:00100000:3.0:1784938449.593173:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144297344 00000100:00100000:2.0:1784938449.593745:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938449.593773:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144297216 00000100:00100000:2.0:1784938449.593777:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144297216 00000100:00100000:1.0:1784938449.593822:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:1.0:1784938449.593831:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:17164:x1871643144297472:12345-192.168.203.126@tcp:5:osp-pre-0-0.0 00000100:00100000:3.0:1784938449.593955:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:3.0:1784938449.593968:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1871643144297344:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938449.593990:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784938449.595045:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1871643144297344:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 1065us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938449.595057:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00002000:00080000:1.0:1784938449.596855:0:19096:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1784938449.596867:0:19096:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1784938449.596873:0:19096:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00010000:00080000:3.0:1784938449.599861:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd5dd500 x1871643144297344/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938449.599890:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144297344:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00080000:0.0:1784938449.600187:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784938449.600194:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938449.604587:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:2.0:1784938449.604602:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144297216:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938449.604699:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144297216:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 102us (10955us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938449.604708:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 25 00000004:00080000:3.0:1784938449.605293:0:17119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:0.0:1784938449.606309:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd5dd880 x1871643144297216/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938449.606327:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144297216:192.168.203.126@tcp:400:kworker.0 00002000:00010000:0.0:1784938449.617729:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938449.617742:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.617760:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1784938449.617765:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938449.617772:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.617789:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.617799:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.617808:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.617836:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938449.618293:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938449.618300:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.618310:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1784938449.618320:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938449.618325:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.618337:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.618346:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.618353:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.618369:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938449.618883:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938449.618892:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.618902:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938449.618907:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.618917:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.618952:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.618959:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7f25df6/0x26783cd1c59ef671 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.618982:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938449.618986:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.618992:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938449.618996:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.619002:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.619013:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.619020:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cd857a6/0x26783cd1c59ef678 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.619030:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.619034:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.619037:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.619045:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938449.619315:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938449.619322:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.619333:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1784938449.619336:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938449.619341:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.619351:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.619359:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.619372:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.619423:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938449.619523:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938449.619530:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.619542:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938449.619546:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.619554:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.619567:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.619574:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091a56d7c/0x26783cd1c59ef67f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.619590:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938449.619592:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938449.619593:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.626670:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.626685:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.626719:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.626723:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.626730:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.626746:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.626757:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.626765:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.626794:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938449.627022:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938449.627029:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.627038:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938449.627042:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.627052:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.627087:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.627096:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef686 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938449.627116:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938449.627119:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938449.627121:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938449.630456:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938449.630471:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.630489:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1784938449.630493:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938449.630500:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.630514:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.630525:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.630533:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.630552:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938449.636654:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938449.636667:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.636694:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1784938449.636698:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938449.636705:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.636719:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.636729:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.636736:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.636762:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938449.637052:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938449.637061:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637070:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938449.637074:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637085:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637114:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637122:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e657fe03/0x26783cd1c59ef68d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637141:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938449.637144:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637151:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938449.637154:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637160:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637169:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637175:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d203ba36/0x26783cd1c59ef694 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.637187:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938449.637188:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938449.637198:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.637300:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.638003:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.638011:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638021:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.638025:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.638030:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638041:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638050:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638057:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638075:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938449.638269:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938449.638275:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.638283:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.638287:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.638296:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.638320:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.638325:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f6faa1/0x26783cd1c59ef69b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.638340:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.638341:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.638342:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.638856:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.638864:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638874:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.638878:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.638882:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638906:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638915:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638922:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.638946:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938449.639101:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938449.639106:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.639114:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.639118:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.639126:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.639138:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.639145:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d25d008/0x26783cd1c59ef6a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.639175:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.639177:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.639179:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.639713:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.639720:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.639729:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.639732:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.639737:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.639746:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.639755:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.639772:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.639793:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938449.639946:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938449.639952:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.639960:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938449.639964:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.639972:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.639984:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.639991:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.640007:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.640009:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.640010:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.640308:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.640314:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.640323:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.640325:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.640329:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.640338:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.640344:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.640352:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.640400:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938449.640773:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.640779:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.640792:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.640795:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.640799:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.640809:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.640818:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.640826:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642623:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938449.642690:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642702:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.642706:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642716:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642734:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642741:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069850173/0x26783cd1c59ef6b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642758:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938449.642761:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642766:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.642777:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642784:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642793:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.642801:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.642803:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.642805:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938449.642895:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784938449.642902:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047ed7f4a/0x26783cd1c59ef6b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.643337:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.643534:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.643539:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.643549:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.643553:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.643557:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.643575:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.643582:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.643586:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.643825:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938449.643917:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938449.643923:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.643931:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938449.643934:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.643949:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.643963:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.643970:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f2dcd8a/0x26783cd1c59ef6be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.643988:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.643990:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.643992:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.644273:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.644280:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.644290:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.644293:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.644298:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.644307:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.644316:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.644333:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.644347:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938449.644726:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938449.644733:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.644741:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.644745:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.644754:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.644766:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.644774:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af2b61cc/0x26783cd1c59ef6c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.644796:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.644798:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.644800:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.644950:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.644957:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.644965:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.644968:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.644973:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.644983:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.644991:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.644998:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.645018:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938449.645082:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938449.645088:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.645096:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.645099:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.645108:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.645118:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.645125:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084065844/0x26783cd1c59ef6cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.645139:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.645141:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.645143:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.645738:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.645745:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.645760:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.645763:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.645767:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.645777:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.645786:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.645794:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.645813:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938449.646298:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938449.646305:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.646313:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938449.646317:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.646326:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.646339:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.646358:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000829e9691/0x26783cd1c59ef6d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.646376:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.646378:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.646380:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.646696:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.646703:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.646712:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.646716:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.646721:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.646730:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.646749:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.646757:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.646777:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938449.647275:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938449.647282:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.647304:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.647308:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.647317:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.647330:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.647336:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f14dfe24/0x26783cd1c59ef6da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.647355:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.647357:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.647359:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.648034:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.648042:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.648054:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.648057:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.648062:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.648074:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.648520:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.648528:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.648568:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938449.648656:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938449.648662:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.648670:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ae00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.648674:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.648683:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.648705:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.648713:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eebbca3f/0x26783cd1c59ef6e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.648729:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.648731:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.648733:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.649964:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.649973:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.649984:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.649989:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.649994:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.650004:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.650013:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.650019:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.650045:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938449.650118:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938449.650125:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.650133:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938449.650138:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.650147:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.650160:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.650168:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f546cc5a/0x26783cd1c59ef6e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938449.650185:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.650187:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.650189:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.652056:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.652069:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.652336:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.652346:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.652597:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.652615:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.652646:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.652654:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.652671:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938449.653824:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.653835:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.653849:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.653853:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.653858:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.653870:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.653879:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.654018:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.654034:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784938449.655489:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.655501:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.655515:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.655519:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.655524:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.655535:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.655544:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.655552:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.655575:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784938449.656338:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.656346:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.656472:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.656477:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.656481:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.656491:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.656501:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.656509:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.656519:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784938449.656854:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.656860:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.656868:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.656871:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.656876:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.656884:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.656916:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.656923:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.656924:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938449.656931:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1784938449.656931:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.656938:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1c00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.656943:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.656951:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.656968:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.656975:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fd0db09/0x26783cd1c59ef6ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657002:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784938449.657007:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657013:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.657016:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657025:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657034:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657041:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fe7fcae/0x26783cd1c59ef6f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657052:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938449.657056:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657062:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0400 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.657065:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657084:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657094:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657101:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009795df26/0x26783cd1c59ef6fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657113:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938449.657116:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657122:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.657125:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657132:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657140:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657146:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef704 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657170:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938449.657173:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657180:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.657183:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657190:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657200:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657207:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000354abf45/0x26783cd1c59ef70b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.657242:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.657244:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.657246:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.657251:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938449.657552:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.657559:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.657568:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.657571:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.657575:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.657583:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.657591:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.657599:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.657640:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938449.657996:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.658002:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658010:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.658013:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.658017:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658027:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658033:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658039:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658050:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784938449.658589:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.658596:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658605:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.658616:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.658620:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658688:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658697:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658704:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.658714:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784938449.659560:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.659568:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.659580:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.659583:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.659587:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.659596:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.659604:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.659618:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.659639:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784938449.660026:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938449.660032:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.660040:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=517s v=(0 0) 00010000:00010000:3.0:1784938449.660044:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938449.660048:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.660057:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.660064:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.660070:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938449.660144:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:3.0:1784938449.660175:0:19096:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1784938449.660288:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17164:x1871643144297472:12345-192.168.203.126@tcp:5:osp-pre-0-0.0 Request processed in 66453us (67365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938449.660305:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:3.0:1784938449.660548:0:17164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17164:1871643144297472:192.168.203.126@tcp:5:osp-pre-0-0.0 00000004:00080000:3.0:1784938449.660565:0:17164:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1784938449.660611:0:17164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17164:1871643144297600:192.168.203.126@tcp:5:osp-pre-0-0.0 00000100:00100000:3.0:1784938449.660672:0:17164:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8d57cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938449.660752:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938449.660777:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144297600 00000100:00100000:3.0:1784938449.660783:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144297600 00000100:00100000:3.0:1784938449.660821:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:3.0:1784938449.660829:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17164:x1871643144297600:12345-192.168.203.126@tcp:5:osp-pre-0-0.0 00002000:00080000:3.0:1784938449.660864:0:18648:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1784938449.660868:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784938449.660876:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.660885:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.660897:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.660907:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.660924:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.660931:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef712 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.660949:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784938449.660953:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.660960:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.660963:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.660969:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.660979:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.660986:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e79ab44/0x26783cd1c59ef719 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661007:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938449.661011:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661017:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.661019:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661027:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661037:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661044:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000400aa94e/0x26783cd1c59ef720 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661057:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938449.661060:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661065:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1c00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.661068:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661087:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661096:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661102:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5bea60d/0x26783cd1c59ef727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661115:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938449.661118:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661124:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938449.661127:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661135:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661143:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661149:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b49f902d/0x26783cd1c59ef72e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938449.661173:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.661174:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.661176:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938449.661183:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938449.661529:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784938449.673856:0:18643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1784938449.673896:0:18643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784938449.674069:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17164:x1871643144297600:12345-192.168.203.126@tcp:5:osp-pre-0-0.0 Request processed in 13234us (13311us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784938449.674079:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:2.0:1784938449.674390:0:17164:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1784938449.674400:0:17164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17164:1871643144297600:192.168.203.126@tcp:5:osp-pre-0-0.0 00000004:00080000:2.0:1784938449.674414:0:17164:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1784938450.207937:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938450.214443:0:19462:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:3.0:1784938450.214447:0:19462:0:(obd_mount.c:922:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1784938450.214448:0:19462:0:(obd_mount.c:925:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1784938450.214558:0:19462:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff910bc6579000 00000020:01000004:3.0:1784938450.214575:0:19462:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784938450.214588:0:19462:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784938450.214602:0:19462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff910cf3bf8000) 00000020:00000080:3.0:1784938450.214620:0:19462:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784938450.276860:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784938450.277953:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784938450.278586:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1784938450.278961:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1784938450.279355:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784938450.279735:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1784938450.279968:0:19462:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1784938450.288432:0:19462:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784938450.288742:0:19462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1784938450.288758:0:19462:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784938450.288770:0:19462:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26783cd1c59ef73c 00000020:01000004:1.0:1784938450.288778:0:19462:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1784938450.288804:0:19462:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784938450.288808:0:19462:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784938450.288814:0:19462:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1784938450.288843:0:19462:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1784938450.288847:0:19462:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1784938450.301880:0:19462:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784938450.301920:0:19462:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1784938450.301925:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784938450.301926:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938450.301928:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938450.301929:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938450.301930:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938450.301931:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938450.301933:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938450.301935:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938450.301936:0:19462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938450.301940:0:19462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1784938450.301942:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938450.301943:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938450.301944:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938450.301945:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938450.301946:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938450.301947:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938450.301948:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938450.301949:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938450.301950:0:19462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938450.302048:0:19462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784938450.302072:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144297728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938450.302144:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.302281:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938450.302378:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144297728 00000100:00100000:0.0:1784938450.302386:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144297728 00000100:00100000:0.0:1784938450.302487:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784938450.302497:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:19462:x1871643144297728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784938450.302540:0:17134:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784938450.302545:0:17134:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1784938450.302549:0:17134:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784938450.302965:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:19462:x1871643144297728:12345-0@lo:253:mount.lustre.0 Request processed in 460us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938450.302975:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784938450.303047:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144297728:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784938450.303058:0:19462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784938450.303060:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938450.303062:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938450.303063:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938450.303064:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938450.303065:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938450.303066:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938450.303067:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938450.303069:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938450.303070:0:19462:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784938450.303094:0:19462:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910bc6579000 from lustre-OST0001 10000000:01000000:1.0:1784938450.303117:0:19462:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784938450.303119:0:19462:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784938450.303127:0:19462:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910bc715b380 local copy 00010000:00010000:1.0:1784938450.303137:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938450.303211:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144297856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938450.303278:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.303555:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938450.303801:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144297856 00000100:00100000:2.0:1784938450.303808:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144297856 00000100:00100000:2.0:1784938450.303838:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784938450.303846:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:19462:x1871643144297856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938450.303921:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:19462:x1871643144297856:12345-0@lo:501:mount.lustre.0 Request processed in 76us (642us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938450.303928:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784938450.304060:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144297856:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784938450.304073:0:19462:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784938450.304091:0:19462:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784938450.304098:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.304106:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b77600/0x26783cd1c59ef38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef392 expref: -99 pid: 17118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938450.304128:0:19462:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910bc6579000 10000000:01000000:1.0:1784938450.304132:0:19462:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784938450.304137:0:19462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784938450.304139:0:19462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938450.304144:0:19462:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784938450.304147:0:19462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784938450.304167:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ef743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.304174:0:19462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ef743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.304192:0:19462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ef743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938450.304204:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144297984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938450.304259:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.304275:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938450.304320:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144297984 00000100:00100000:0.0:1784938450.304324:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144297984 00000100:00100000:0.0:1784938450.304346:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784938450.304352:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:19462:x1871643144297984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938450.304361:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938450.304373:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ef74a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef743 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.304394:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ef74a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef743 expref: 22 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.304405:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b77800/0x26783cd1c59ef74a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef743 expref: 22 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.304424:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77800, rc 0) 00000100:00100000:0.0:1784938450.304462:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144297984:12345-0@lo:101:mount.lustre.0 Request processed in 110us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938450.304468:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784938450.304565:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144297984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938450.304587:0:19462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ef743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef74a expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.304597:0:19462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ef743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef74a expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938450.306393:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1784938450.307139:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938450.309388:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1784938450.309497:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1784938450.309519:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1784938450.309534:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1784938450.309548:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1784938450.309561:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1784938450.309583:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1784938450.309589:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1784938450.311376:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938450.311604:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.311784:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938450.311988:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144298112 00000100:00100000:0.0:1784938450.311996:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144298112 00000100:00100000:0.0:1784938450.312053:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784938450.312062:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144298112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938450.312246:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144298112:12345-0@lo:501:mount.lustre.0 Request processed in 184us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938450.312254:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784938450.312356:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938450.312411:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938450.312458:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.312525:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938450.313210:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144298240 00000100:00100000:3.0:1784938450.313299:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144298240 00000100:00100000:3.0:1784938450.313333:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784938450.313341:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144298240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938450.315518:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144298240:12345-0@lo:503:mount.lustre.0 Request processed in 2168us (3050us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.315532:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784938450.315766:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938450.316277:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938450.316370:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938450.316415:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.316449:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938450.316484:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144298368 00000100:00100000:2.0:1784938450.316491:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144298368 00000100:00100000:2.0:1784938450.316526:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784938450.316534:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144298368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938450.317045:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144298368:12345-0@lo:502:mount.lustre.0 Request processed in 509us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.317054:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784938450.317612:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938450.317879:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1784938450.317904:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1784938450.317914:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1784938450.317923:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1784938450.317933:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1784938450.317942:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1784938450.317951:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1784938450.317962:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1784938450.317975:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1784938450.318004:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938450.318054:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.318087:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938450.318153:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144298496 00000100:00100000:0.0:1784938450.318158:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144298496 00000100:00100000:0.0:1784938450.318197:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784938450.318204:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144298496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938450.318328:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144298496:12345-0@lo:502:mount.lustre.0 Request processed in 124us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938450.318335:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784938450.318373:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784938450.318417:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1784938450.318425:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1784938450.319935:0:19466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938450.319949:0:19466:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1784938450.320034:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938450.320046:0:19466:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784938450.320053:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938450.320071:0:19466:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff910bc7540000) 00000020:00000080:2.0:1784938450.320099:0:19466:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784938450.320106:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784938450.320187:0:19466:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910bc6579000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1784938450.320197:0:19466:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784938450.320204:0:19466:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x26783cd1c59ef758 00010000:00010000:2.0:1784938450.326210:0:19466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1784938450.327969:0:19466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1784938450.330462:0:19466:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1784938450.333551:0:19466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1784938450.333565:0:19466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938450.333573:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938450.333575:0:19466:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1784938450.333579:0:19466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938450.333583:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938450.333584:0:19466:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938450.333588:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938450.333590:0:19466:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784938450.333605:0:19466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938450.333607:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938450.333609:0:19466:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784938450.333611:0:19466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938450.333613:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938450.333615:0:19466:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784938450.333618:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784938450.333669:0:19466:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938450.333673:0:19466:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938450.333675:0:19466:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784938450.333678:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1784938450.333820:0:19462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1784938450.333850:0:19462:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784938450.333869:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ef743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef74a expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.333881:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d1000/0x26783cd1c59ef743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef74a expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938450.333888:0:19462:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910bc6579000 from 1 10000000:01000000:0.0:1784938450.333891:0:19462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938450.333933:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.333942:0:19462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.333963:0:19462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938450.333988:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938450.334054:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938450.334098:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938450.334244:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144298624 00000100:00100000:2.0:1784938450.334252:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144298624 00000100:00100000:2.0:1784938450.334295:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784938450.334303:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:19462:x1871643144298624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938450.334315:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938450.334327:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef75f expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.334345:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef75f expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.334355:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef75f expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938450.334363:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cffbc1400, rc 0) 00000100:00100000:2.0:1784938450.334396:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144298624:12345-0@lo:101:mount.lustre.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.334402:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784938450.334701:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938450.334717:0:19462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938450.334727:0:19462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938450.344363:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1784938450.344836:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938450.345182:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1784938450.345210:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1784938450.345298:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1784938450.345305:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1784938450.345394:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938450.345459:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938450.345496:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc94e7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938450.345751:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144298752 00000100:00100000:3.0:1784938450.345759:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144298752 00000100:00100000:3.0:1784938450.345816:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784938450.345825:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144298752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938450.346067:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144298752:12345-0@lo:501:mount.lustre.0 Request processed in 242us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.346075:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784938450.346362:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938450.346403:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938450.346460:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.346487:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938450.348964:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144298880 00000100:00100000:0.0:1784938450.348978:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144298880 00000100:00100000:0.0:1784938450.349032:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784938450.349042:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144298880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938450.349272:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144298880:12345-0@lo:503:mount.lustre.0 Request processed in 230us (2810us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938450.349280:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784938450.349395:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144298880:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938450.349983:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938450.350088:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938450.350143:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.350263:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938450.350387:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144299008 00000100:00100000:2.0:1784938450.350392:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144299008 00000100:00100000:2.0:1784938450.350433:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784938450.350453:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144299008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938450.350609:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144299008:12345-0@lo:502:mount.lustre.0 Request processed in 168us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.350617:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784938450.354071:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938450.354758:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1784938450.354794:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1784938450.354808:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1784938450.354822:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1784938450.354835:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1784938450.354850:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1784938450.354865:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1784938450.354879:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1784938450.354893:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1784938450.354906:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1784938450.354920:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1784938450.354960:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938450.355044:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938450.355094:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938450.355179:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144299136 00000100:00100000:2.0:1784938450.355185:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144299136 00000100:00100000:2.0:1784938450.355326:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784938450.355336:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144299136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938450.355584:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144299136:12345-0@lo:502:mount.lustre.0 Request processed in 249us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.355592:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784938450.355790:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938450.355852:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1784938450.355862:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1784938450.357057:0:19470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938450.357068:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938450.357070:0:19470:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784938450.357078:0:19470:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910bc6579000 00000020:00000080:3.0:1784938450.357081:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938450.357089:0:19470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938450.357091:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938450.357093:0:19470:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784938450.357095:0:19470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938450.357097:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938450.357099:0:19470:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784938450.357102:0:19470:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff910bc6579000 00000020:00000080:3.0:1784938450.357104:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938450.357195:0:19470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938450.357199:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938450.357200:0:19470:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784938450.357203:0:19470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938450.357206:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938450.357207:0:19470:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784938450.357211:0:19470:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910bc6579000 00000020:00000080:3.0:1784938450.357242:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938450.357568:0:19470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938450.357573:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938450.357574:0:19470:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784938450.357577:0:19470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938450.357580:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938450.357582:0:19470:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784938450.357585:0:19470:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910bc6579000 00000020:00000080:3.0:1784938450.357587:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938450.357613:0:19470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938450.357616:0:19470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938450.357618:0:19470:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784938450.357700:0:19470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1784938450.359304:0:19462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784938450.359348:0:19462:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938450.359366:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.359378:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938450.359436:0:19462:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784938450.359439:0:19462:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910bc6579000 10000000:01000000:1.0:1784938450.359517:0:19462:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910bc6579000 10000000:01000000:1.0:1784938450.359523:0:19462:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938450.359529:0:19462:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff910bc6579000 from 1 10000000:01000000:1.0:1784938450.359532:0:19462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938450.359574:0:19462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ef76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.359583:0:19462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ef76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.359595:0:19462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ef76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938450.364760:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938450.364842:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.364891:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938450.365146:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144299264 00000100:00100000:3.0:1784938450.365154:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144299264 00000100:00100000:3.0:1784938450.365294:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784938450.365304:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:19462:x1871643144299264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938450.365321:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938450.365339:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1400/0x26783cd1c59ef774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef76d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.365366:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1400/0x26783cd1c59ef774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef76d expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.365375:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1400/0x26783cd1c59ef774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef76d expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.365383:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1400, rc 0) 00000100:00100000:3.0:1784938450.365424:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299264:12345-0@lo:101:mount.lustre.0 Request processed in 122us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.365430:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784938450.365532:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938450.365548:0:19462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ef76d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef774 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.365558:0:19462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ef76d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef774 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938450.366998:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1784938450.367296:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938450.367885:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784938450.367917:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1784938450.367945:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1784938450.367958:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1784938450.367972:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1784938450.367984:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1784938450.367996:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1784938450.368008:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1784938450.368020:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1784938450.368034:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1784938450.368045:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1784938450.368058:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1784938450.368070:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1784938450.368083:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1784938450.368097:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1784938450.368111:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1784938450.368125:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1784938450.368152:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1784938450.368179:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1784938450.368196:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1784938450.368210:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1784938450.368265:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1784938450.368279:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1784938450.368291:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1784938450.368304:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1784938450.368317:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1784938450.368329:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1784938450.368343:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1784938450.368356:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1784938450.368368:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1784938450.368380:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1784938450.368392:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1784938450.368405:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1784938450.368417:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1784938450.368509:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1784938450.368528:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1784938450.368539:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1784938450.368551:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1784938450.368564:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1784938450.368578:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1784938450.368592:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1784938450.368604:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1784938450.368615:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1784938450.368927:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1784938450.368945:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1784938450.368958:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1784938450.368980:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1784938450.368986:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1784938450.369092:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938450.369173:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.369315:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938450.369377:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144299392 00000100:00100000:3.0:1784938450.369384:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144299392 00000100:00100000:3.0:1784938450.369438:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784938450.369457:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938450.369583:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299392:12345-0@lo:501:mount.lustre.0 Request processed in 127us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.369591:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784938450.369851:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938450.369880:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938450.369920:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.369938:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938450.369982:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144299520 00000100:00100000:3.0:1784938450.369986:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144299520 00000100:00100000:3.0:1784938450.370017:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784938450.370024:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938450.370100:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299520:12345-0@lo:503:mount.lustre.0 Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.370107:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784938450.370559:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938450.370968:0:19462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938450.371035:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938450.371081:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.371113:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938450.371312:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144299648 00000100:00100000:3.0:1784938450.371317:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144299648 00000100:00100000:3.0:1784938450.371350:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784938450.371357:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938450.371510:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299648:12345-0@lo:502:mount.lustre.0 Request processed in 153us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.371517:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784938450.371789:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938450.371979:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784938450.372019:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1784938450.372035:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1784938450.372047:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1784938450.372058:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1784938450.372070:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1784938450.372083:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1784938450.372097:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1784938450.372109:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784938450.372122:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1784938450.372136:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1784938450.372150:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1784938450.372163:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1784938450.372176:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1784938450.372189:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1784938450.372240:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1784938450.372258:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1784938450.372282:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1784938450.372297:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1784938450.372308:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1784938450.372319:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1784938450.372332:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1784938450.372345:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1784938450.372358:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1784938450.372371:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1784938450.372382:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1784938450.372394:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1784938450.372405:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1784938450.372417:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1784938450.372428:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1784938450.372439:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1784938450.373356:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1784938450.373370:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1784938450.373398:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1784938450.373414:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1784938450.373428:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1784938450.373439:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1784938450.373450:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1784938450.373461:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1784938450.373471:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1784938450.373483:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1784938450.373495:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1784938450.373507:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1784938450.373520:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1784938450.373533:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1784938450.373547:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1784938450.373562:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1784938450.373575:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1784938450.374930:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938450.375014:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.375061:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938450.375122:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144299776 00000100:00100000:3.0:1784938450.375130:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144299776 00000100:00100000:3.0:1784938450.375191:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784938450.375200:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938450.375340:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299776:12345-0@lo:502:mount.lustre.0 Request processed in 141us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.375358:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784938450.375480:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938450.376814:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1784938450.376868:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1784938450.376913:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938450.376981:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.377022:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938450.379781:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144299904 00000100:00100000:0.0:1784938450.379796:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144299904 00000100:00100000:0.0:1784938450.379857:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784938450.379868:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938450.380207:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144299904:12345-0@lo:502:mount.lustre.0 Request processed in 340us (3224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938450.380233:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784938450.380366:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144299904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938450.380530:0:19462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1784938450.380544:0:19462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1784938450.390449:0:19475:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784938450.390468:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff910cf3bfb380) 00000020:00000080:3.0:1784938450.390495:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1784938450.390785:0:19475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910bc6579000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784938450.390789:0:19475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910bc6579000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784938450.390791:0:19475:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910bc6579000 3 00010000:00080000:3.0:1784938450.390824:0:19475:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc7c88800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1784938450.392456:0:19475:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1784938450.392560:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1784938450.392600:0:19475:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938450.392615:0:19475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x26783cd1c59ef782 00000100:00080000:3.0:1784938450.392637:0:19475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:3.0:1784938450.392648:0:19475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff910bc7c88800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938450.392684:0:19475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc77c7b80 x1871643144300032/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938450.392727:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144300032:192.168.203.126@tcp:38:llog_process_th.0 00000100:00100000:3.0:1784938450.392991:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938450.393019:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144300032 00000100:00100000:3.0:1784938450.393026:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144300032 00000100:00100000:3.0:1784938450.393057:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:3.0:1784938450.393064:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1871643144300032:12345-192.168.203.126@tcp:38:llog_process_th.0 00010000:00080000:3.0:1784938450.393087:0:17141:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:3.0:1784938450.393116:0:17141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x26783cd1c59ef789 00000004:00100000:3.0:1784938450.393128:0:17141:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784938450.393169:0:17141:0:(import.c:65:import_set_state_nolock()) ffff910bc7c8e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938450.393236:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1871643144300032:12345-192.168.203.126@tcp:38:llog_process_th.0 Request processed in 150us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.393244:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00010000:00080000:3.0:1784938450.393342:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc77c7b80 x1871643144300032/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938450.393352:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784938450.393360:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1784938450.393367:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784938450.393371:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784938450.393373:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc7c88800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784938450.393379:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1871643144300032:192.168.203.126@tcp:38:llog_process_th.0 00000100:00080000:3.0:1784938450.393400:0:19475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784938450.393445:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938450.393449:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784938450.393451:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938450.393456:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.203.126@tcp last attempt 517 00000100:00080000:3.0:1784938450.393461:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784938450.393465:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910cc487f000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938450.393478:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910bc77c4a80 x1871643144300416/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938450.393528:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938450.393531:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784938450.393532:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938450.393548:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 192.168.203.126@tcp last attempt 517 00000100:00080000:3.0:1784938450.393551:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784938450.393555:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff910cdf495800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938450.393568:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cffb25c00 x1871643144300928/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938450.393607:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144300160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.393720:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144300288:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.393764:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144301056:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.393873:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938450.393896:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938450.393925:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144300288 00000100:00100000:2.0:1784938450.393930:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144300288 00000100:00100000:2.0:1784938450.393966:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:2.0:1784938450.393973:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144300288:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.394007:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144300288:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.394013:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 1 00000100:00100000:2.0:1784938450.394032:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144301056 00000100:00100000:2.0:1784938450.394035:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144301056 00000100:00100000:2.0:1784938450.394059:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:2.0:1784938450.394065:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144301056:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.394089:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1871643144301056:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.394095:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:2.0:1784938450.394200:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144300288:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938450.394211:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb26d80 x1871643144301056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938450.394247:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1871643144301056:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.397320:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144300416:192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938450.397407:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144300928:192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938450.397580:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938450.397607:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938450.399786:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144300416 00000100:00100000:2.0:1784938450.399799:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144300416 00000100:00100000:2.0:1784938450.399840:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144300928 00000100:00100000:2.0:1784938450.399843:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144300928 00000100:00100000:2.0:1784938450.399863:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:2.0:1784938450.399872:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1871643144300416:12345-192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938450.399955:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1871643144300416:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 83us (2374us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784938450.399962:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 11 00000100:00100000:2.0:1784938450.399978:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:2.0:1784938450.399983:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1871643144300928:12345-192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938450.400007:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1871643144300928:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 23us (2399us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784938450.400012:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 12 00000100:00100000:2.0:1784938450.400034:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144300672:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.400075:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144301312:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.400103:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784938450.400109:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144300544:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.400128:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144301184:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.400357:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938450.400379:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938450.400396:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938450.400412:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938450.400428:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144301312 00000100:00100000:2.0:1784938450.400431:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144301312 00000100:00100000:2.0:1784938450.400461:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144300544 00000100:00100000:2.0:1784938450.400463:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144300544 00000100:00100000:2.0:1784938450.400483:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144301184 00000100:00100000:2.0:1784938450.400486:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144301184 00000100:00100000:2.0:1784938450.400497:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:2.0:1784938450.400503:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144301312:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.400544:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1871643144301312:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 40us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.400550:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 27 00000100:00100000:2.0:1784938450.400564:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00100000:2.0:1784938450.400570:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144300544:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.400592:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144300544:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.400597:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 28 00000100:00100000:2.0:1784938450.400608:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 29 00000100:00100000:2.0:1784938450.400614:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144301184:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.401774:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1871643144301184:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 1152us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.401783:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 29 00010000:00080000:2.0:1784938450.402030:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910bc77c7480 x1871643144300544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938450.402046:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144300544:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938450.402057:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb25500 x1871643144301184/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938450.402065:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1871643144301184:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938450.402088:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cffb27100 x1871643144301312/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938450.402096:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1871643144301312:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938450.402141:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938450.402148:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938450.402152:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-11) 00000100:00100000:2.0:1784938450.402156:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144300416:192.168.203.126@tcp:8:kworker.0 00000100:00100000:2.0:1784938450.402166:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938450.402169:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938450.402172:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.126@tcp failed (-11) 00000100:00100000:2.0:1784938450.402176:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144300928:192.168.203.126@tcp:8:kworker.0 00000020:01000004:2.0:1784938450.402367:0:19475:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784938450.402384:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff910cc9430000) 00000020:00000080:2.0:1784938450.402408:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1784938450.402574:0:19475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910bc6579000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784938450.402579:0:19475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910bc6579000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784938450.402582:0:19475:0:(obd_mount.c:706:lustre_put_lsi()) put ffff910bc6579000 3 00010000:00080000:2.0:1784938450.402613:0:19475:0:(ldlm_lib.c:125:import_set_conn()) imp ffff910bc7112000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.126@tcp at head 00000100:00100000:3.0:1784938450.402772:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144300672 00000100:00100000:3.0:1784938450.402780:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144300672 00000100:00100000:3.0:1784938450.402839:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:3.0:1784938450.402848:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144300672:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938450.402902:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144300672:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 56us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.402909:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:3.0:1784938450.403051:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144300672:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938450.403145:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938450.403165:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144300160 00000100:00100000:3.0:1784938450.403168:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144300160 00000100:00100000:3.0:1784938450.403187:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:3.0:1784938450.403192:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144300160:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938450.403235:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144300160:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 42us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.403241:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:3.0:1784938450.403311:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144300160:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938450.403321:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144300800:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938450.403402:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938450.403421:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144300800 00000100:00100000:3.0:1784938450.403424:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144300800 00000100:00100000:3.0:1784938450.403454:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:3.0:1784938450.403460:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144300800:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938450.403485:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144300800:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.403491:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:3.0:1784938450.403555:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144300800:192.168.203.126@tcp:400:kworker.0 00010000:00010000:2.0:1784938450.408957:0:19475:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1784938450.409079:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1784938450.409141:0:19475:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784938450.409155:0:19475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x26783cd1c59ef797 00000100:00080000:2.0:1784938450.409169:0:19475:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 192.168.203.126@tcp last attempt 0 00000100:00080000:2.0:1784938450.409182:0:19475:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff910bc7112000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:2.0:1784938450.409244:0:19475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cfd5dd180 x1871643144301440/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938450.409294:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1871643144301440:192.168.203.126@tcp:38:llog_process_th.0 00000100:00080000:2.0:1784938450.410018:0:19475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1784938450.410383:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1784938450.410518:0:19462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784938450.410549:0:19462:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938450.410571:0:19462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ef76d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef774 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.410582:0:19462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d1e00/0x26783cd1c59ef76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef774 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784938450.410648:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784938450.410651:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938450.410652:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938450.410653:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938450.410654:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938450.410656:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938450.410657:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938450.410659:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938450.410661:0:19462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784938450.410665:0:19462:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1784938450.410672:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938450.410674:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938450.410674:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938450.410675:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938450.410676:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938450.410677:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938450.410678:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938450.410679:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938450.410680:0:19462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784938450.410702:0:19462:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784938450.410717:0:19462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144301568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938450.410781:0:19462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.410811:0:19462:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cca3e4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938450.410831:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144301568 00000100:00100000:1.0:1784938450.410837:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144301568 00000100:00100000:1.0:1784938450.410878:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784938450.410887:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144301568:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784938450.410913:0:17133:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784938450.410927:0:17133:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784938450.411422:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938450.411446:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144301440 00000100:00100000:2.0:1784938450.411450:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144301440 00000100:00100000:2.0:1784938450.411473:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:2.0:1784938450.411478:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1871643144301440:12345-192.168.203.126@tcp:38:llog_process_th.0 00010000:00080000:2.0:1784938450.411501:0:19429:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1784938450.411532:0:19429:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x26783cd1c59ef79e 00000004:00100000:2.0:1784938450.411542:0:19429:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938450.411575:0:19429:0:(import.c:65:import_set_state_nolock()) ffff910bc6752000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938450.411641:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1871643144301440:12345-192.168.203.126@tcp:38:llog_process_th.0 Request processed in 161us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938450.411649:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00010000:00080000:2.0:1784938450.411887:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910cfd5dd180 x1871643144301440/t0(0) o38->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938450.411899:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938450.411906:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1784938450.411913:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784938450.411917:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784938450.411920:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910bc7112000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784938450.411926:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1871643144301440:192.168.203.126@tcp:38:llog_process_th.0 20000000:01000000:1.0:1784938450.421148:0:17133:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938450.421204:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784938450.422272:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:19462:x1871643144301568:12345-0@lo:253:mount.lustre.0 Request processed in 11381us (11484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938450.422284:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784938450.422404:0:19462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:19462:1871643144301568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784938450.422418:0:19462:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784938450.422421:0:19462:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938450.422423:0:19462:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784938450.422424:0:19462:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938450.422426:0:19462:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938450.422427:0:19462:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938450.422428:0:19462:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938450.422430:0:19462:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938450.422432:0:19462:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938450.422433:0:19462:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784938450.422447:0:19462:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1784938450.432022:0:17155:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784938450.432029:0:17155:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784938450.433373:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.433393:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef647 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.433401:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef655 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.433409:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.433446:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef655 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.433459:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef655 expref: 23 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938450.433473:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144301696:0@lo:104: 00000100:00100000:3.0:1784938450.433539:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784938450.433637:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef647 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.433646:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef647 expref: 23 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938450.433655:0:17155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144301824:0@lo:104: 00000100:00100000:3.0:1784938450.433677:0:17155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1784938450.434811:0:19462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1784938450.437276:0:19462:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784938450.437286:0:19462:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784938450.437323:0:19462:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784938450.437366:0:19462:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784938450.437384:0:19462:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1784938450.437403:0:19462:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000100:00100000:1.0:1784938450.444783:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144301696 00000100:00100000:1.0:1784938450.444795:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144301696 00000100:00100000:3.0:1784938450.444915:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144301824 00000100:00100000:3.0:1784938450.444920:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144301824 00000100:00100000:3.0:1784938450.444975:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938450.444984:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:17155:x1871643144301824:12345-0@lo:104: 00010000:00010000:3.0:1784938450.445001:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.445720:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938450.445729:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:17155:x1871643144301824:12345-0@lo:104: Request processed in 746us (12050us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938450.445737:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:00000004:3.0:1784938450.446987:0:19462:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784938450.447263:0:19462:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784938450.451828:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938450.451842:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.451854:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0600 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:1.0:1784938450.451858:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.451878:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938450.451885:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938450.451891:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938450.451935:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.451942:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938450.451962:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.451969:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cc97d0600/0x26783cd1c59ef647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef64e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.451983:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938450.451985:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938450.451986:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938450.452008:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144301952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938450.452070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.452140:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144301952 00000100:00100000:1.0:1784938450.452148:0:17893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144301952 00010000:00010000:1.0:1784938450.452174:0:17893:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef647 expref: 24 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938450.452202:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784938450.452210:0:17893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3640:x1871643144301952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938450.452303:0:17893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938450.452310:0:17893:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef647 expref: 24 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.452319:0:17893:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef647 expref: 24 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.452336:0:17893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938450.452370:0:17893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3640:x1871643144301952:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938450.452376:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784938450.452448:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144301952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938450.454947:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938450.454959:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:17155:x1871643144301696:12345-0@lo:104: 00010000:00010000:1.0:1784938450.454978:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455053:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938450.455059:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:17155:x1871643144301696:12345-0@lo:104: Request processed in 104us (21520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938450.455066:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1784938450.455089:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938450.455094:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455101:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0a00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:1.0:1784938450.455105:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455122:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938450.455129:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938450.455134:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938450.455167:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455173:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938450.455189:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455196:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cc97d0a00/0x26783cd1c59ef655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef65c expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455229:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938450.455231:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938450.455233:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938450.455247:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144302080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938450.455284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938450.455328:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144302080 00000100:00100000:1.0:1784938450.455335:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144302080 00010000:00010000:1.0:1784938450.455352:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef655 expref: 24 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938450.455374:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938450.455380:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3641:x1871643144302080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938450.455395:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938450.455400:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef655 expref: 24 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455409:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef655 expref: 24 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455425:0:17126:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455434:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938450.455449:0:17126:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.023420510s 00010000:00010000:1.0:1784938450.455454:0:17126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455460:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455467:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455473:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455479:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938450.455482:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455490:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455505:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938450.455514:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938450.455544:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3641:x1871643144302080:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938450.455551:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938450.455593:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144302080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938450.460398:0:17155:0:(client.c:2702:ptlrpc_set_wait()) set ffff910ce6bd96c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784938450.460442:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cffbc1000/0x26783cd1c59ef65c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef655 expref: 23 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938450.460458:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb25500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144301696:0@lo:104: 00010000:00010000:3.0:1784938450.460471:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cffbc1c00/0x26783cd1c59ef64e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef647 expref: 22 pid: 17131 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938450.460493:0:17155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17155:1871643144301824:0@lo:104: 00010000:00010000:3.0:1784938450.460516:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.460527:0:17155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.460532:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938450.460537:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938451.235438:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784938451.337745:0:19529:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784938451.337978:0:19529:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784938452.257110:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784938452.383784:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784938452.383792:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910bc7112800 from 10 10000000:01000000:1.0:1784938452.383796:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938452.383845:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d0600/0x26783cd1c59ef7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938452.383857:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d020d0600/0x26783cd1c59ef7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938452.383868:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d020d0600/0x26783cd1c59ef7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938452.383894:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144302208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938452.383955:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938452.383991:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc3701cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938452.390126:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144302208 00000100:00100000:3.0:1784938452.390234:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144302208 00000100:00100000:3.0:1784938452.390292:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784938452.390302:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:17136:x1871643144302208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938452.390319:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938452.390339:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef7ac expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.390639:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef7ac expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.390652:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1200/0x26783cd1c59ef7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef7ac expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.390661:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1200, rc 0) 00000100:00100000:3.0:1784938452.390747:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144302208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 447us (6791us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938452.390754:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784938452.390882:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144302208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938452.390900:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d020d0600/0x26783cd1c59ef7ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef7b3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.390910:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d020d0600/0x26783cd1c59ef7ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef7b3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938452.390973:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144302336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784938452.391089:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938452.391121:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d019c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938452.391136:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144302336 00000100:00100000:3.0:1784938452.391240:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144302336 00000100:00100000:3.0:1784938452.391272:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784938452.391279:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144302336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784938452.391295:0:17133:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784938452.391311:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784938452.391314:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1784938452.391496:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144302336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 216us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938452.391503:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784938452.391603:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144302336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784938452.391668:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938452.391676:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d0600/0x26783cd1c59ef7ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef7b3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.391690:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d0600/0x26783cd1c59ef7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef7b3 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938452.391700:0:17136:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784938452.391702:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff910cc871e000 from 10 10000000:01000000:3.0:1784938452.391705:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784938452.391726:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ef7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.391733:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ef7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.391742:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ef7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938452.391756:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144302464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938452.391852:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938452.391868:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc7d019c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938452.391880:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144302464 00000100:00100000:3.0:1784938452.391883:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144302464 00000100:00100000:3.0:1784938452.391903:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784938452.391909:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144302464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938452.391916:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938452.391926:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ef7c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef7ba expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.391941:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ef7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef7ba expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.391959:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1600/0x26783cd1c59ef7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef7ba expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938452.391966:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1600, rc 0) 00000100:00100000:3.0:1784938452.392072:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:17136:x1871643144302464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938452.392078:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784938452.392935:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144302464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938452.392953:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ef7ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef7c1 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938452.392974:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ef7ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef7c1 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938452.393025:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144302592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784938452.393067:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938452.393092:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc3701b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938452.393107:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144302592 00000100:00100000:1.0:1784938452.393111:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144302592 00000100:00100000:1.0:1784938452.393141:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784938452.393149:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:17136:x1871643144302592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784938452.393165:0:17134:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784938452.393181:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784938452.393184:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1784938452.393276:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:17136:x1871643144302592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938452.393285:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784938452.393317:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144302592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784938452.393381:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938452.393388:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ef7ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef7c1 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938452.393395:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0800/0x26783cd1c59ef7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef7c1 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938452.646277:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144302720:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:1.0:1784938452.646976:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938452.647099:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144302720 00000100:00100000:2.0:1784938452.647108:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144302720 00000100:00100000:2.0:1784938452.647170:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:2.0:1784938452.647181:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144302720:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938452.647209:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784938452.647269:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144302720:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938452.647276:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:3.0:1784938452.648432:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144302720:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00080000:1.0:1784938452.648539:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784938453.279562:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938453.669785:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938453.669813:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144302848:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:3.0:1784938453.670078:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938453.670107:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144302848 00000100:00100000:3.0:1784938453.670115:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144302848 00000100:00100000:3.0:1784938453.670159:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:3.0:1784938453.670167:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144302848:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938453.670201:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784938453.670264:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144302848:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 96us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938453.670270:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:3.0:1784938453.670421:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144302848:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938453.685813:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938453.685838:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144302976:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938453.686078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938453.686104:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144302976 00000100:00100000:0.0:1784938453.686110:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144302976 00000100:00100000:0.0:1784938453.686154:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:0.0:1784938453.686163:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144302976:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938453.686209:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784938453.686273:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144302976:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 110us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938453.686280:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:0.0:1784938453.686397:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144302976:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:1.0:1784938454.304994:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938454.690943:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144303104:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938454.691177:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938454.691259:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144303104 00000100:00100000:2.0:1784938454.691268:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144303104 00000100:00100000:2.0:1784938454.691337:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:2.0:1784938454.691348:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144303104:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938454.691378:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784938454.691417:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144303104:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938454.691424:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00080000:0.0:1784938454.692144:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938454.692502:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144303104:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938455.327534:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938455.711513:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938455.711526:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784938455.711530:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938455.711542:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910cc487f000 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938455.711567:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cfd4bad80 x1871643144303616/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938455.711618:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938455.711621:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784938455.711623:0:36:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938455.711628:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff910cdf495800 using connection 192.168.203.126@tcp/192.168.203.126@tcp 00000100:00100000:3.0:1784938455.712136:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910cfd4b9880 x1871643144304128/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938455.712254:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144303232:0@lo:400:kworker.0 00000100:00100000:3.0:1784938455.712318:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938455.712360:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144303872:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938455.712542:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144303232 00000100:00100000:1.0:1784938455.712550:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144303232 00000100:00100000:1.0:1784938455.712608:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784938455.712617:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3642:x1871643144303232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938455.712704:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144304512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938455.721443:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3642:x1871643144303232:12345-0@lo:400:kworker.0 Request processed in 8818us (9115us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938455.721457:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784938455.722777:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144303232:0@lo:400:kworker.0 00000100:00100000:3.0:1784938455.722796:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784938455.722808:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144303360:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.722848:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144304000:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.722869:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144304640:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.722906:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144303488:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.722945:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144304256:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.722963:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144304768:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.722987:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784938455.722993:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144303744:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.723011:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144304384:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.723042:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144303616:192.168.203.126@tcp:8:kworker.0 00000100:00100000:3.0:1784938455.723062:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144304128:192.168.203.126@tcp:8:kworker.0 00000100:00100000:3.0:1784938455.723323:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938455.723385:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938455.737026:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938455.737081:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938455.737113:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938455.737140:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938455.737167:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938455.740096:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144303872 00000100:00100000:0.0:1784938455.740112:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144303872 00000100:00100000:0.0:1784938455.740172:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144303360 00000100:00100000:0.0:1784938455.740175:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144303360 00000100:00100000:0.0:1784938455.740195:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:0.0:1784938455.740205:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144303872:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938455.740314:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144303872:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 110us (16991us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938455.740322:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:0.0:1784938455.740338:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:0.0:1784938455.740345:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144303360:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938455.740375:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144303360:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 31us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938455.740381:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:0.0:1784938455.740609:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144303872:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938455.741012:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144304512 00000100:00100000:2.0:1784938455.741019:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144304512 00000100:00100000:2.0:1784938455.741054:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144304640 00000100:00100000:2.0:1784938455.741058:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144304640 00000100:00100000:2.0:1784938455.741069:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144304256 00000100:00100000:2.0:1784938455.741071:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144304256 00000100:00100000:2.0:1784938455.741081:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144304384 00000100:00100000:2.0:1784938455.741084:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144304384 00000100:00100000:2.0:1784938455.741098:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00100000:2.0:1784938455.741105:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144304512:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938455.741152:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144304512:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 47us (17766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938455.741158:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 30 00000100:00100000:2.0:1784938455.741173:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:2.0:1784938455.741179:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144304640:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938455.741202:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144304640:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (4120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938455.741208:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 31 00000100:00100000:2.0:1784938455.741232:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:2.0:1784938455.741238:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144304256:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938455.741261:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144304256:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938455.741267:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 32 00000100:00100000:2.0:1784938455.741277:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:2.0:1784938455.741283:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144304384:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938455.741304:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144304384:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 21us (4164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938455.741319:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 33 00000100:00100000:2.0:1784938455.741340:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144303616 00000100:00100000:2.0:1784938455.741344:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144303616 00000100:00100000:2.0:1784938455.741365:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:2.0:1784938455.741369:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1871643144303616:12345-192.168.203.126@tcp:8:kworker.0 00010000:00080000:2.0:1784938455.741396:0:18646:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1784938455.741421:0:18646:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x26783cd1c59ef7c8 00002000:00100000:2.0:1784938455.741432:0:18646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff910cdf5cc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784938455.741436:0:18646:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1784938455.741439:0:18646:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1784938455.742045:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4b8380 x1871643144304384/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938455.742059:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144304384:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938455.742073:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4b9500 x1871643144304256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938455.742089:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144304256:192.168.203.126@tcp:400:kworker.0 00002000:00080000:2.0:1784938455.742312:0:18646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784938455.742342:0:18646:0:(import.c:65:import_set_state_nolock()) ffff910cdf5ca000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938455.742385:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1871643144303616:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 1014us (5217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938455.742393:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00080000:0.0:1784938455.743182:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938455.743189:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784938455.743258:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4b8000 x1871643144304640/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938455.743272:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144304640:192.168.203.126@tcp:400:kworker.0 00010000:00080000:0.0:1784938455.743293:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4b8700 x1871643144304512/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938455.743303:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144304512:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.749710:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938455.749763:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938455.749797:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938455.749826:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144304768 00000100:00100000:3.0:1784938455.749834:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144304768 00000100:00100000:3.0:1784938455.749890:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00100000:3.0:1784938455.749899:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144304768:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.749962:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144304768:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 65us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938455.749969:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 34 00000100:00080000:3.0:1784938455.749989:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938455.750012:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938455.750030:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144303744 00000100:00100000:3.0:1784938455.750033:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144303744 00000100:00100000:3.0:1784938455.750064:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 35 00000100:00100000:3.0:1784938455.750069:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144303744:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.750093:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144303744:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938455.750100:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 35 00000100:00100000:3.0:1784938455.750161:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938455.750178:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144304000 00000100:00100000:3.0:1784938455.750182:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144304000 00000100:00100000:3.0:1784938455.750210:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144303488 00000100:00100000:1.0:1784938455.750333:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144304128 00000100:00100000:1.0:1784938455.750337:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144304128 00000100:00100000:1.0:1784938455.750354:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:1.0:1784938455.750361:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144304000:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938455.750396:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144304000:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 36us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938455.750409:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 3 00000100:00100000:1.0:1784938455.750422:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:1.0:1784938455.750426:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1871643144304128:12345-192.168.203.126@tcp:8:kworker.0 00010000:00080000:1.0:1784938455.750454:0:18649:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@192.168.203.126@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1784938455.750482:0:18649:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x26783cd1c59ef7cf 00002000:00100000:1.0:1784938455.750492:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff910bc713d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1784938455.750497:0:18649:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1784938455.750499:0:18649:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784938455.750558:0:18649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1784938455.750583:0:18649:0:(import.c:65:import_set_state_nolock()) ffff910bc713a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938455.750626:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1871643144304128:12345-192.168.203.126@tcp:8:kworker.0 Request processed in 198us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938455.750632:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 14 00010000:00080000:1.0:1784938455.750829:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4bad80 x1871643144303616/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938455.750846:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784938455.750854:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784938455.750859:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784938455.750861:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cc487f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784938455.750875:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784938455.750881:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1871643144303616:192.168.203.126@tcp:8:kworker.0 00000004:00080000:1.0:1784938455.750933:0:17166:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1784938455.750953:0:17166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb65880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17166:1871643144305024:192.168.203.126@tcp:5:osp-pre-1-0.0 00000100:00100000:1.0:1784938455.751004:0:17166:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc8d57a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938455.751020:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144304896:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938455.751108:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938455.751132:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938455.751156:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144304896 00000100:00100000:1.0:1784938455.751160:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144304896 00000100:00100000:1.0:1784938455.751190:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:1.0:1784938455.751197:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144304896:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938455.751319:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144303488 00000100:00100000:3.0:1784938455.751340:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144305024 00000100:00100000:3.0:1784938455.751343:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144305024 00000100:00100000:3.0:1784938455.751355:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:3.0:1784938455.751361:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144303488:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938455.751394:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144303488:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 34us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938455.751401:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 4 00000100:00100000:3.0:1784938455.751414:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:3.0:1784938455.751420:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:17166:x1871643144305024:12345-192.168.203.126@tcp:5:osp-pre-1-0.0 00000100:00080000:3.0:1784938455.751632:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938455.751635:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1784938455.751834:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784938455.751869:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1871643144304896:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 671us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938455.751876:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:1.0:1784938455.752030:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144303488:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938455.752064:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144303360:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938455.752076:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144304000:192.168.203.126@tcp:400:kworker.0 00000004:00080000:0.0:1784938455.752400:0:17165:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938455.752475:0:17165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 523784259921ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784938455.752482:0:17165:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:1.0:1784938455.753832:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb67480 x1871643144304896/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938455.753857:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144304896:192.168.203.126@tcp:13:osp-pre-1-0.0 00010000:00080000:1.0:1784938455.753895:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4b9880 x1871643144304128/t0(0) o8->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938455.753907:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1784938455.753915:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784938455.753927:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784938455.753930:0:3639:0:(import.c:65:import_set_state_nolock()) ffff910cdf495800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784938455.753956:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784938455.753962:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1871643144304128:192.168.203.126@tcp:8:kworker.0 00010000:00080000:1.0:1784938455.753993:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4bb480 x1871643144303744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938455.754003:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144303744:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938455.754017:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4b8e00 x1871643144304768/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938455.754026:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144304768:192.168.203.126@tcp:400:kworker.0 00000004:00080000:0.0:1784938455.754313:0:17882:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938455.754406:0:17882:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 523786190925ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784938455.754412:0:17882:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1784938455.756734:0:17883:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1784938455.756762:0:17883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17883:1871643144305280:192.168.203.126@tcp:7:osp-pre-1-1.0 00000100:00100000:3.0:1784938455.756834:0:17883:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfa349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938455.756849:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938455.756860:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144305152:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938455.757050:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938455.757077:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938455.757456:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144305152 00000100:00100000:1.0:1784938455.757464:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144305152 00000100:00100000:1.0:1784938455.757526:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:1.0:1784938455.757534:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1871643144305152:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938455.757556:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784938455.757611:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1871643144305152:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 77us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938455.757618:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00080000:3.0:1784938455.757909:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784938455.760632:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4b9c00 x1871643144305152/t0(0) o13->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938455.762431:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144305152:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938455.762477:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144305280 00000100:00100000:1.0:1784938455.762485:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144305280 00000100:00100000:1.0:1784938455.762547:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 16 00000004:00080000:3.0:1784938455.762825:0:17119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784938455.763726:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17883:x1871643144305280:12345-192.168.203.126@tcp:7:osp-pre-1-1.0 00002000:00080000:3.0:1784938455.765724:0:18646:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1784938455.765737:0:18646:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1784938455.765742:0:18646:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:1.0:1784938455.768144:0:17871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1784938455.774762:0:18649:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1784938455.774775:0:18649:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784938455.774856:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17883:x1871643144305280:12345-192.168.203.126@tcp:7:osp-pre-1-1.0 Request processed in 12295us (17803us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938455.774867:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 16 00010000:00080000:2.0:1784938455.775076:0:17883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4ba680 x1871643144305280/t0(0) o7->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938471 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938455.775092:0:17883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17883:1871643144305280:192.168.203.126@tcp:7:osp-pre-1-1.0 00000004:00080000:2.0:1784938455.775105:0:17883:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784938455.775155:0:17883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17883:1871643144305408:192.168.203.126@tcp:5:osp-pre-1-1.0 00000100:00100000:2.0:1784938455.775201:0:17883:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf789ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938455.775738:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938455.775761:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144305408 00000100:00100000:2.0:1784938455.775768:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144305408 00000100:00100000:2.0:1784938455.775804:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:2.0:1784938455.775812:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17883:x1871643144305408:12345-192.168.203.126@tcp:5:osp-pre-1-1.0 00002000:00080000:2.0:1784938455.775836:0:18648:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1784938455.775866:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17883:x1871643144305408:12345-192.168.203.126@tcp:5:osp-pre-1-1.0 Request processed in 55us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938455.775873:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 17 00010000:00080000:2.0:1784938455.775961:0:17883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd5dd180 x1871643144305408/t0(0) o5->lustre-OST0001-osc-MDT0001@192.168.203.126@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938471 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938455.775972:0:17883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17883:1871643144305408:192.168.203.126@tcp:5:osp-pre-1-1.0 00000004:00080000:2.0:1784938455.775981:0:17883:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784938455.776007:0:17883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17883:1871643144305536:192.168.203.126@tcp:5:osp-pre-1-1.0 00000100:00100000:2.0:1784938455.776032:0:17883:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf789ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938455.776086:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938455.776104:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144305536 00000100:00100000:2.0:1784938455.776107:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144305536 00000100:00100000:2.0:1784938455.776127:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:2.0:1784938455.776132:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17883:x1871643144305536:12345-192.168.203.126@tcp:5:osp-pre-1-1.0 00002000:00080000:2.0:1784938455.776157:0:18649:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1784938455.798924:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.798939:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.798956:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.798960:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.798966:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.798985:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.798996:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.799003:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.799021:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938455.800049:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.800068:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.800080:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.800084:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.800089:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.800100:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.800110:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.800117:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.800139:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938455.801638:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938455.801665:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801677:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938455.801682:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801692:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801712:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801719:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b49f902d/0x26783cd1c59ef7d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801740:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938455.801743:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801749:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938455.801752:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801758:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801776:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801784:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000400aa94e/0x26783cd1c59ef7dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.801796:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.801798:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.801800:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.801807:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938455.802833:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.802845:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.802860:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.802864:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.802870:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.802883:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.802966:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.802975:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.803000:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938455.805671:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.805694:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.805710:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.805715:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.805721:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.805735:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.805745:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.805753:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.805789:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784938455.805808:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938455.805818:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805829:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.805834:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805845:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805866:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805880:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef7e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805900:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.805904:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805910:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.805913:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805921:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805930:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805937:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef7eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.805947:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.805949:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.805951:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938455.807036:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.807047:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.807059:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.807063:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.807068:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.807081:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.807091:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.807099:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.807169:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784938455.809394:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.809407:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.809421:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.809430:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.809435:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.809447:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.809457:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.809463:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813164:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938455.813178:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813194:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938455.813199:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813290:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813314:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813323:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354abf45/0x26783cd1c59ef7f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813367:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938455.813371:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813378:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938455.813381:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813389:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813399:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.813407:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.813408:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.813410:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.815098:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.817374:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784938455.817387:0:18646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef7f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.818489:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.822256:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.822374:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822392:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.822397:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.822403:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822417:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822427:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822435:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822454:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938455.822522:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938455.822531:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.822541:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938455.822546:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.822568:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.822698:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938455.822720:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.822727:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822735:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.822739:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.822743:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822752:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822765:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822772:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822784:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938455.822862:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.822868:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822876:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.822880:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822889:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822901:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822908:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae294383/0x26783cd1c59ef807 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.822927:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.822934:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.822937:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.823120:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef800 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.823142:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.823144:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.823146:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.823667:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.823673:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823682:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.823686:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.823691:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823701:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823709:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823716:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823732:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938455.823838:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.823843:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823850:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76400 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.823855:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823875:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823887:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823894:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088597c98/0x26783cd1c59ef80e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823926:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.823928:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.823930:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.823968:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.823973:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.823981:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.823985:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.823989:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.824441:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.824450:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.824465:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.824480:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938455.824605:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.824611:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.824620:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.824624:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.824634:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.824648:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.824656:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef815 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.824677:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.824679:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.824681:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.825440:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.825457:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.825469:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.825473:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.825478:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.825489:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.825499:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.825506:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.825528:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938455.825831:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938455.825840:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.825850:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938455.825854:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.825865:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.825879:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.825899:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef81c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.825916:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.825918:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.825920:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.826518:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.826527:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.826537:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.826541:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.826547:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.826558:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.826574:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.826582:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.826619:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938455.826853:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938455.826860:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.826868:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938455.826872:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.826880:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.826905:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.826913:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd857a6/0x26783cd1c59ef823 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.826928:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.826930:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.826931:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.827534:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.827542:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.827552:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.827556:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.827560:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.827571:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.827579:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.827601:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.827637:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938455.827969:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938455.827977:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.827987:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938455.827992:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.828002:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.828014:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.828020:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f25df6/0x26783cd1c59ef82a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.828051:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.828053:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.828055:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.828466:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.828473:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.828482:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.828485:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.828490:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.828502:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.828510:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.828518:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.828541:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938455.829016:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938455.829023:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.829032:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215ae00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938455.829037:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.829045:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.829057:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.829065:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebbca3f/0x26783cd1c59ef831 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.829083:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.829085:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.829087:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.830188:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.830199:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830310:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.830321:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.830327:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830341:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830351:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830359:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830379:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938455.830540:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.830546:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830555:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215b800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.830559:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830570:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830594:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830614:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f14dfe24/0x26783cd1c59ef838 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.830635:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.830637:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.830638:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784938455.832571:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938455.832582:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.833385:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784938455.833391:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938455.833400:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.833417:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.833428:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.833436:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.833466:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938455.833802:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938455.833809:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.833835:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938455.833840:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.833850:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.833869:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.833876:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af2b61cc/0x26783cd1c59ef83f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.833896:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.833898:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.833900:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.838306:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.838326:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.838348:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.838353:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.838361:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.838377:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.838389:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.838398:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.838426:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938455.838972:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.839122:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839135:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.839138:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.839145:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839158:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839168:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839175:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839199:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784938455.839388:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938455.839397:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839407:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.839413:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839425:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839457:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839465:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000829e9691/0x26783cd1c59ef846 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839491:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.839495:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839502:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d0215a000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.839505:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839753:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839769:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839777:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084065844/0x26783cd1c59ef84d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.839793:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.839797:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.839805:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.839952:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.840097:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840108:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.840112:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.840116:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840128:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840138:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840146:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840172:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938455.840371:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.840379:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840390:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.840394:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840415:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840434:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840442:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e657fe03/0x26783cd1c59ef854 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.840482:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.840485:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.840491:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938455.841121:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.842404:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.842421:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.842440:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.842445:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.842452:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.842934:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.842948:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843106:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843131:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938455.843445:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.843453:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843462:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.843468:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843480:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843499:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843507:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d203ba36/0x26783cd1c59ef85b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843598:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.843601:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.843603:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938455.843680:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784938455.843695:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843705:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938455.843709:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938455.843714:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843724:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843731:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843738:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.843761:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938455.843812:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938455.843841:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.843858:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76e00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938455.843874:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.843886:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.843907:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.843914:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a56d7c/0x26783cd1c59ef862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.843941:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.843943:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.843944:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784938455.845405:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1784938455.845453:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1784938455.845459:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1784938455.845825:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784938455.845837:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.845936:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784938455.845942:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938455.845949:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.846161:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.846173:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.846182:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.846313:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938455.846789:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17883:x1871643144305536:12345-192.168.203.126@tcp:5:osp-pre-1-1.0 Request processed in 70647us (70694us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784938455.846802:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:2.0:1784938455.847455:0:17883:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1784938455.847470:0:17883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17883:1871643144305536:192.168.203.126@tcp:5:osp-pre-1-1.0 00000004:00080000:2.0:1784938455.847490:0:17883:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1784938455.850340:0:17883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17883:1871643144305664:192.168.203.126@tcp:900:osp-pre-1-1.0 00002000:00010000:3.0:1784938455.850445:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1784938455.850455:0:17883:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf789ce40 going to sleep for 11 seconds 00010000:00010000:3.0:1784938455.850462:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.850483:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.850489:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.850497:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.850526:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.850538:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.850547:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852666:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938455.852685:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852705:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938455.852706:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938455.852713:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852746:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852774:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852795:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20a3e9a/0x26783cd1c59ef869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852826:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.852831:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852838:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.852841:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852865:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852880:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852888:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037c0f5b8/0x26783cd1c59ef870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.852916:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.852919:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.852921:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.852937:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938455.853326:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00002000:00010000:3.0:1784938455.853834:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.853846:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.853863:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.853867:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.853874:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.853888:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.853899:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.853918:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.853949:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938455.854161:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144305664 00000100:00100000:0.0:1784938455.854173:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144305664 00000100:00100000:0.0:1784938455.854247:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2 00000100:00100000:0.0:1784938455.854259:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17883:x1871643144305664:12345-192.168.203.126@tcp:900:osp-pre-1-1.0 00000100:00100000:0.0:1784938455.854370:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17883:x1871643144305664:12345-192.168.203.126@tcp:900:osp-pre-1-1.0 Request processed in 112us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938455.854379:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2 00010000:00010000:2.0:1784938455.855011:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938455.855021:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.855031:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0400 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938455.855042:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.855052:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.855070:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.855077:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009795df26/0x26783cd1c59ef877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938455.855096:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.855098:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938455.855100:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1784938455.855141:0:17883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc77c7b80 x1871643144305664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@192.168.203.126@tcp:29/10 lens 264/248 e 0 to 0 dl 1784938471 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938455.855156:0:17883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17883:1871643144305664:192.168.203.126@tcp:900:osp-pre-1-1.0 00002000:00010000:3.0:1784938455.855310:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.855316:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.855325:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.855329:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.855333:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.855343:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.855352:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.855359:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.855375:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938455.855923:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.855934:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.855948:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0200 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.855954:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.855966:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.855995:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.856021:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fe7fcae/0x26783cd1c59ef87e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.856055:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.856057:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.856058:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938455.856371:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.856381:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.856397:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.856400:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.856405:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.856416:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.856425:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.856433:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.856451:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938455.857341:0:18295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.857352:0:18295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.857365:0:18295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.857371:0:18295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.857382:0:18295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.857400:0:18295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.857408:0:18295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4fbeb4/0x26783cd1c59ef885 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.857427:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.857429:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.857431:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784938455.857561:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784938455.857570:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.857581:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1784938455.857643:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938455.857649:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.857661:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.857682:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.857689:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938455.857845:0:18646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1784938455.857900:0:18646:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1784938455.857987:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17166:x1871643144305024:12345-192.168.203.126@tcp:5:osp-pre-1-0.0 Request processed in 106562us (106875us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938455.857997:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:2.0:1784938455.859573:0:17166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb65880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17166:1871643144305024:192.168.203.126@tcp:5:osp-pre-1-0.0 00000004:00080000:2.0:1784938455.859602:0:17166:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1784938455.859648:0:17166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17166:1871643144305792:192.168.203.126@tcp:5:osp-pre-1-0.0 00000100:00100000:2.0:1784938455.859703:0:17166:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cf789ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938455.859797:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938455.859821:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144305792 00000100:00100000:2.0:1784938455.859827:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144305792 00000100:00100000:2.0:1784938455.859879:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:2.0:1784938455.859886:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17166:x1871643144305792:12345-192.168.203.126@tcp:5:osp-pre-1-0.0 00002000:00080000:2.0:1784938455.859921:0:19096:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1784938455.865833:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938455.865845:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.865859:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:0.0:1784938455.865864:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.865874:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.865895:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.865902:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e79ab44/0x26783cd1c59ef88c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938455.865926:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.865928:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938455.865930:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938455.867946:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17166:x1871643144305792:12345-192.168.203.126@tcp:5:osp-pre-1-0.0 Request processed in 8051us (8141us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1784938455.867958:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:2.0:1784938455.868455:0:17166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc77c7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17166:1871643144305792:192.168.203.126@tcp:5:osp-pre-1-0.0 00000004:00080000:2.0:1784938455.868471:0:17166:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1784938456.351437:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938456.805325:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1784938457.033016:0:19818:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784938457.375300:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938457.761026:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938457.761059:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144305920:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938457.761773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938457.761942:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144305920 00000100:00100000:1.0:1784938457.761954:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144305920 00000100:00100000:1.0:1784938457.762045:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:1.0:1784938457.762057:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144305920:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938457.762098:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784938457.762161:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144305920:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 107us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938457.762170:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00080000:0.0:1784938457.762638:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938457.762735:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144305920:192.168.203.126@tcp:13:osp-pre-0-1.0 00000020:00000004:1.0:1784938458.271681:0:19870:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938458.271943:0:19870:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784938458.400319:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938458.786300:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938458.786334:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144306048:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938458.787980:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938458.788013:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc7f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144306176:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938458.792634:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938458.792690:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938458.800346:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144306176 00000100:00100000:2.0:1784938458.800362:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144306176 00000100:00100000:2.0:1784938458.800438:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144306048 00000100:00100000:2.0:1784938458.800443:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144306048 00000100:00100000:2.0:1784938458.800468:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:2.0:1784938458.800479:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144306176:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:2.0:1784938458.800531:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784938458.800888:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144306176:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 306us (8172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938458.800900:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:2.0:1784938458.800928:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:2.0:1784938458.800937:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144306048:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938458.800959:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784938458.801301:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144306048:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 365us (8610us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938458.801309:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:0.0:1784938458.804598:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144306048:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938458.805294:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc7f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144306176:192.168.203.126@tcp:41:osp-pre-1-0.0 00000020:00000004:1.0:1784938459.195390:0:19921:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784938459.195715:0:19921:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784938459.411588:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.411683:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125337856 00000100:00100000:2.0:1784938459.411706:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125337856 00000100:00100000:2.0:1784938459.411763:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:2.0:1784938459.411774:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2391:x1871643125337856:12345-192.168.203.26@tcp:250:mount.lustre.0 00010000:00080000:2.0:1784938459.411812:0:17133:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0@192.168.203.26@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:2.0:1784938459.411851:0:17133:0:(genops.c:1406:class_connect()) connect: client 2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0, cookie 0x26783cd1c59ef893 00000100:00080000:2.0:1784938459.412041:0:17133:0:(import.c:65:import_set_state_nolock()) ffff910cecbc5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938459.412150:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+5:2391:x1871643125337856:12345-192.168.203.26@tcp:250:mount.lustre.0 Request processed in 376us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.412158:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 114 00010000:00010000:0.0:1784938459.423430:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938459.426447:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938459.426699:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125337984 00000100:00100000:3.0:1784938459.426713:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125337984 00000100:00100000:3.0:1784938459.429675:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:3.0:1784938459.429701:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+5:14900:x1871643125337984:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938459.429727:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938459.429750:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ef89a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28a29 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.429788:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ef89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a29 expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.429802:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0e00/0x26783cd1c59ef89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a29 expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.429821:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0e00, rc 0) 00000100:00100000:3.0:1784938459.429926:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+6:14900:x1871643125337984:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 235us (3491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938459.429935:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:0.0:1784938459.441548:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938459.441619:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125338112 00000100:00100000:0.0:1784938459.441634:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125338112 00000100:00100000:0.0:1784938459.441716:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:0.0:1784938459.441728:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+6:14900:x1871643125338112:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784938459.441892:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+6:14900:x1871643125338112:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 166us (358us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938459.441902:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:3.0:1784938459.451102:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938459.451174:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125338240 00000100:00100000:3.0:1784938459.451188:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125338240 00000100:00100000:3.0:1784938459.451288:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 117 00000100:00100000:3.0:1784938459.451300:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+6:14900:x1871643125338240:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938459.451325:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938459.451350:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1800/0x26783cd1c59ef8a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28a30 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.451385:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1800/0x26783cd1c59ef8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a30 expref: 7 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.451398:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1800/0x26783cd1c59ef8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a30 expref: 7 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.451409:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1800, rc 0) 00000100:00100000:3.0:1784938459.451485:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+7:14900:x1871643125338240:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 187us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938459.451493:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 117 00000100:00100000:3.0:1784938459.455767:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.455910:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125338368 00000100:00100000:2.0:1784938459.455924:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125338368 00000100:00100000:2.0:1784938459.455995:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:2.0:1784938459.456006:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+7:14900:x1871643125338368:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784938459.456258:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14900:x1871643125338368:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 254us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.456267:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:2.0:1784938459.462809:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.468240:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125338496 00000100:00100000:2.0:1784938459.468261:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125338496 00000100:00100000:2.0:1784938459.468335:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:2.0:1784938459.468347:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14900:x1871643125338496:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784938459.468556:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14900:x1871643125338496:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 211us (5761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.471100:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:2.0:1784938459.481994:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938459.482110:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125338624 00000100:00100000:1.0:1784938459.482123:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125338624 00000100:00100000:1.0:1784938459.482195:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:1.0:1784938459.482205:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14918:x1871643125338624:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938459.482416:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14918:x1871643125338624:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 211us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938459.482425:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:3.0:1784938459.516921:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.517108:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125338752 00000100:00100000:2.0:1784938459.517122:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125338752 00000100:00100000:2.0:1784938459.517198:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:2.0:1784938459.517210:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14918:x1871643125338752:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938459.517462:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14918:x1871643125338752:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 254us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.517473:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:1.0:1784938459.521161:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.521405:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125338880 00000100:00100000:2.0:1784938459.521419:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125338880 00000100:00100000:2.0:1784938459.521496:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:2.0:1784938459.521509:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14918:x1871643125338880:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938459.521736:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14918:x1871643125338880:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 229us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.521745:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:3.0:1784938459.526637:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938459.526967:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125339008 00000100:00100000:1.0:1784938459.526981:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125339008 00000100:00100000:1.0:1784938459.527063:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:1.0:1784938459.527076:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+8:14900:x1871643125339008:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938459.527101:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938459.527126:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef8a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28a61 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938459.527164:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a61 expref: 9 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938459.527178:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d0400/0x26783cd1c59ef8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a61 expref: 9 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938459.527190:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d0400, rc 0) 00000100:00100000:2.0:1784938459.528540:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+9:14900:x1871643125339008:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 1451us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.528578:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:3.0:1784938459.534050:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.537025:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125339136 00000100:00100000:2.0:1784938459.537046:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125339136 00000100:00100000:2.0:1784938459.537132:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:2.0:1784938459.537144:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cef3b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+9:14900:x1871643125339136:12345-192.168.203.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784938459.537185:0:17134:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784938459.537244:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784938459.537249:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784938459.537252:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784938459.537255:0:17134:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784938459.537263:0:17134:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1784938459.540522:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cef3b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+9:14900:x1871643125339136:12345-192.168.203.26@tcp:256:mount.lustre.0 Request processed in 3365us (6473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.540539:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:3.0:1784938459.543382:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.543885:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125339264 00000100:00100000:2.0:1784938459.543899:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125339264 00000100:00100000:2.0:1784938459.544042:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:2.0:1784938459.544057:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd29dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+9:14900:x1871643125339264:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784938459.544084:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938459.544109:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28a68 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938459.544147:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a68 expref: 10 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938459.544161:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a68 expref: 10 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938459.544173:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0600, rc 0) 00000100:00100000:2.0:1784938459.544297:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd29dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:14900:x1871643125339264:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 243us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.544306:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:3.0:1784938459.549201:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.549514:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125339392 00000100:00100000:2.0:1784938459.549529:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125339392 00000100:00100000:2.0:1784938459.549663:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:2.0:1784938459.549674:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:14900:x1871643125339392:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784938459.549889:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:14900:x1871643125339392:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 215us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.549917:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:1.0:1784938459.556019:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938459.559928:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125339520 00000100:00100000:0.0:1784938459.559953:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125339520 00000100:00100000:0.0:1784938459.560031:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:0.0:1784938459.560044:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:14900:x1871643125339520:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784938459.560347:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:14900:x1871643125339520:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 304us (4342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938459.560357:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:3.0:1784938459.571925:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938459.572144:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125339648 00000100:00100000:0.0:1784938459.572159:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125339648 00000100:00100000:0.0:1784938459.572269:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:0.0:1784938459.572282:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:14924:x1871643125339648:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938459.572543:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:14924:x1871643125339648:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 263us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938459.572553:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:1.0:1784938459.582477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938459.582752:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125339776 00000100:00100000:3.0:1784938459.582766:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125339776 00000100:00100000:3.0:1784938459.582843:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:3.0:1784938459.582855:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:14924:x1871643125339776:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938459.583080:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:14924:x1871643125339776:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 226us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938459.583090:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:1.0:1784938459.604628:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938459.604779:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125339904 00000100:00100000:3.0:1784938459.604793:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125339904 00000100:00100000:3.0:1784938459.604854:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1784938459.604864:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2391:x1871643125339904:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784938459.604902:0:19429:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5@192.168.203.26@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1784938459.604967:0:19429:0:(genops.c:1406:class_connect()) connect: client dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5, cookie 0x26783cd1c59ef8b6 00000004:00100000:3.0:1784938459.604997:0:19429:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784938459.605283:0:19429:0:(import.c:65:import_set_state_nolock()) ffff910bc7c8a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938459.605375:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:2391:x1871643125339904:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 510us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938459.605460:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:1.0:1784938459.605769:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938459.606252:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125340160 00000100:00100000:3.0:1784938459.606262:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125340160 00000100:00100000:3.0:1784938459.606311:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:3.0:1784938459.606319:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1871643125340160:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784938459.606372:0:17141:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5@192.168.203.26@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1784938459.606559:0:17141:0:(genops.c:1406:class_connect()) connect: client dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5, cookie 0x26783cd1c59ef8bd 00000004:00100000:3.0:1784938459.606598:0:17141:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1784938459.607989:0:17141:0:(import.c:65:import_set_state_nolock()) ffff910bc7c8b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938459.608106:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:2391:x1871643125340160:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 1785us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938459.608121:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:1.0:1784938459.613371:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938459.613683:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.613718:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125340032 00000100:00100000:2.0:1784938459.613733:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125340032 00000100:00100000:2.0:1784938459.613839:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:2.0:1784938459.613852:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:0:x1871643125340032:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784938459.613904:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:0.0:1784938459.613965:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938459.614016:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:0:x1871643125340032:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 167us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.614024:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1784938459.615852:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938459.615960:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125340288 00000100:00100000:0.0:1784938459.615973:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125340288 00000100:00100000:0.0:1784938459.616055:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125340416 00000100:00100000:0.0:1784938459.616059:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125340416 00000100:00100000:0.0:1784938459.616089:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1784938459.616100:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:0:x1871643125340288:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938459.616150:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784938459.616269:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:0:x1871643125340288:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 170us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938459.616278:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1784938459.616302:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1784938459.616309:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14900:x1871643125340416:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938459.616323:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784938459.616354:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14900:x1871643125340416:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 46us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938459.616360:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00080000:3.0:1784938459.616533:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938459.624730:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938459.626049:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125340544 00000100:00100000:0.0:1784938459.626067:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125340544 00000100:00100000:0.0:1784938459.626171:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:0.0:1784938459.626185:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14900:x1871643125340544:12345-192.168.203.26@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784938459.630885:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14900:x1871643125340544:12345-192.168.203.26@tcp:40:mount.lustre.0 Request processed in 4681us (6148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938459.630907:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:0.0:1784938459.636808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938459.636866:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.636919:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125340672 00000100:00100000:2.0:1784938459.636933:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125340672 00000100:00100000:2.0:1784938459.637000:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1784938459.637001:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938459.637014:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1871643125340672:12345-192.168.203.26@tcp:8:mount.lustre.0 00000100:00100000:0.0:1784938459.637039:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125340800 00000100:00100000:0.0:1784938459.637045:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125340800 00010000:00080000:2.0:1784938459.637061:0:18649:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5@192.168.203.26@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:2.0:1784938459.637102:0:18649:0:(genops.c:1406:class_connect()) connect: client dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5, cookie 0x26783cd1c59ef8c4 00000100:00100000:1.0:1784938459.637118:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125340928 00002000:00100000:2.0:1784938459.637120:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5/ffff910cecbc3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1784938459.637125:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125340928 00002000:00100000:2.0:1784938459.637147:0:18649:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1784938459.637170:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:1.0:1784938459.637178:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc7f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14900:x1871643125340928:12345-192.168.203.26@tcp:900:mount.lustre.0 00000100:00100000:1.0:1784938459.637309:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14900:x1871643125340928:12345-192.168.203.26@tcp:900:mount.lustre.0 Request processed in 130us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938459.637317:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00002000:00080000:2.0:1784938459.637434:0:18649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784938459.637469:0:18649:0:(import.c:65:import_set_state_nolock()) ffff910cecbc6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938459.637522:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc7f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:2391:x1871643125340672:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 510us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.637530:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1784938459.637547:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1784938459.637572:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1871643125340800:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784938459.637592:0:18649:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5@192.168.203.26@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:2.0:1784938459.637612:0:18649:0:(genops.c:1406:class_connect()) connect: client dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5, cookie 0x26783cd1c59ef8cb 00002000:00100000:2.0:1784938459.637618:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5/ffff910cecbc2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784938459.637630:0:18649:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784938459.637746:0:18649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784938459.637764:0:18649:0:(import.c:65:import_set_state_nolock()) ffff910cecbc4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938459.637791:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:2391:x1871643125340800:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 230us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938459.637811:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1784938459.641970:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938459.644919:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125341056 00000100:00100000:1.0:1784938459.644942:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125341056 00000100:00100000:1.0:1784938459.645017:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:1.0:1784938459.645029:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14900:x1871643125341056:12345-192.168.203.26@tcp:33:mount.lustre.0 00000004:00080000:1.0:1784938459.653577:0:17142:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8411us 00000004:00200000:1.0:1784938459.688731:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784938459.688925:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14900:x1871643125341056:12345-192.168.203.26@tcp:33:mount.lustre.0 Request processed in 43890us (46958us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938459.688939:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000040:00080000:0.0:1784938459.744814:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784938459.809281:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938459.809317:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144306304:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938459.809788:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938459.810002:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144306304 00000100:00100000:3.0:1784938459.810014:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144306304 00000100:00100000:3.0:1784938459.810103:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:3.0:1784938459.810115:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144306304:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938459.810150:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784938459.810243:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144306304:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 129us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938459.810251:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:1.0:1784938459.810390:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144306304:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00080000:2.0:1784938459.810420:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938459.889665:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938459.889882:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125341184 00000100:00100000:3.0:1784938459.889896:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125341184 00000100:00100000:3.0:1784938459.889979:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:3.0:1784938459.889991:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14947:x1871643125341184:12345-192.168.203.26@tcp:101:mkdir.0 00010000:00010000:3.0:1784938459.890022:0:19429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938459.890060:0:19429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1000/0x26783cd1c59ef8d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28a99 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.890150:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59ef8d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.890186:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59ef8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.890203:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59ef8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938459.890520:0:19429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784938459.890526:0:19429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938459.890586:0:19429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59ef8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.890622:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1000/0x26783cd1c59ef8d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a99 expref: 8 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.890648:0:19429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59ef8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a99 expref: 7 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938459.890659:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938459.890662:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938459.890667:0:19429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1c00, rc 0) 00000100:00100000:3.0:1784938459.890864:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:14947:x1871643125341184:12345-192.168.203.26@tcp:101:mkdir.0 Request processed in 874us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938459.890874:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00010000:00010000:0.0:1784938460.447448:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938460.841621:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144306560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938460.841754:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144307072:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938460.841785:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144307584:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938460.841819:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784938460.841825:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144306688:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938460.841848:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144307200:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938460.841866:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144307712:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938460.844057:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938460.844345:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144306560 00000100:00100000:3.0:1784938460.844359:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144306560 00000100:00100000:3.0:1784938460.844432:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:3.0:1784938460.844444:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144306560:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938460.844579:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144306560:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 138us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938460.844594:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:3.0:1784938460.844647:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144306816:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938460.844707:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144307328:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938460.844735:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144307840:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938460.844772:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1784938460.844784:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144306432:0@lo:400:kworker.0 00000100:00100000:1.0:1784938460.844798:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144308224:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938460.845510:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144308096:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:1.0:1784938460.847857:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938460.847902:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144307584 00000100:00100000:1.0:1784938460.847913:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144307584 00000100:00100000:0.0:1784938460.848030:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938460.848236:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144307200 00000100:00100000:0.0:1784938460.848241:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144307200 00000100:00100000:1.0:1784938460.848242:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00100000:1.0:1784938460.848258:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144307584:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938460.848283:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:0.0:1784938460.848294:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144307200:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938460.848489:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144307584:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 235us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938460.848498:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 36 00000100:00080000:1.0:1784938460.848525:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938460.848530:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938460.848649:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938460.848734:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938460.848736:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144307072 00000100:00100000:2.0:1784938460.848742:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144307072 00000100:00100000:1.0:1784938460.848757:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144306816 00000100:00100000:1.0:1784938460.848764:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144306816 00000100:00100000:2.0:1784938460.848779:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:2.0:1784938460.848789:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144307072:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938460.848803:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:1.0:1784938460.848813:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144306816:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938460.848828:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144307072:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 40us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938460.848836:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 48 00000100:00100000:1.0:1784938460.848849:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144306816:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938460.848898:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938460.849751:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 6 00000100:00100000:1.0:1784938460.849777:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144306688 00000100:00100000:1.0:1784938460.849783:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144306688 00000100:00100000:1.0:1784938460.849819:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00100000:1.0:1784938460.849827:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144306688:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938460.849878:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144306688:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 52us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938460.849885:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 7 00000100:00080000:1.0:1784938460.849908:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938460.849956:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938460.850007:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938460.850029:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144308224 00000100:00100000:1.0:1784938460.850033:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144308224 00000100:00100000:2.0:1784938460.850042:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938460.850065:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:1.0:1784938460.850074:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144308224:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938460.850085:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938460.850109:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00002000:00000024:1.0:1784938460.850119:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784938460.850148:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1871643144308224:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 77us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938460.850153:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:1.0:1784938460.850161:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144308096 00000100:00100000:1.0:1784938460.850163:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144308096 00000100:00100000:1.0:1784938460.850178:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:1.0:1784938460.850182:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144308096:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:1.0:1784938460.850188:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784938460.850275:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144307328 00000100:00100000:2.0:1784938460.850286:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144307328 00000100:00100000:2.0:1784938460.850310:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:2.0:1784938460.850318:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144307328:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938460.850372:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3642:x1871643144307328:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 55us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938460.850380:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 8 00000100:00100000:2.0:1784938460.850405:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144307712 00000100:00100000:2.0:1784938460.850409:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144307712 00000100:00100000:2.0:1784938460.850436:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144307840 00000100:00100000:2.0:1784938460.850440:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144307840 00000100:00100000:1.0:1784938460.850461:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144308096:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 275us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938460.850463:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:2.0:1784938460.850475:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144307712:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938460.850476:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00080000:1.0:1784938460.850503:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938460.850507:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784938460.850512:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938460.850513:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144307712:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 37us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938460.850522:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 37 00000100:00100000:1.0:1784938460.850529:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:1.0:1784938460.850538:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144307840:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938460.850579:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144307840:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 42us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938460.850585:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 38 00000100:00100000:1.0:1784938460.850747:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144306560:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938460.850765:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144307584:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938460.851753:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144306688:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938460.851775:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587d500 x1871643144307712/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938460.851800:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144307712:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938460.851814:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144307072:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938460.852145:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144308224:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938460.852188:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffbfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144308096:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938460.852385:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144307200:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 4090us (4353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938460.852404:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 5 00000100:00100000:3.0:1784938460.853295:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938460.855041:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144306944:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938460.855185:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144307456:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938460.855261:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144307968:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938460.855329:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144306816:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938460.855346:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144307328:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938460.855368:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144307840:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938460.855424:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144307200:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938460.855819:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938460.855855:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938460.855881:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938460.855909:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144306944 00000100:00100000:3.0:1784938460.855917:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144306944 00000100:00100000:3.0:1784938460.855985:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144307456 00000100:00100000:3.0:1784938460.855989:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144307456 00000100:00100000:3.0:1784938460.856002:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144307968 00000100:00100000:3.0:1784938460.856004:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144307968 00000100:00100000:3.0:1784938460.856035:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:3.0:1784938460.856045:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144306944:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938460.856108:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144306944:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 64us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938460.856117:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 39 00000100:00100000:3.0:1784938460.856136:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:3.0:1784938460.856142:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144307456:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938460.856166:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144307456:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938460.856180:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 40 00000100:00100000:3.0:1784938460.856194:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00100000:3.0:1784938460.856200:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144307968:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938460.856255:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144307968:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938460.856261:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 41 00000100:00080000:3.0:1784938460.856281:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938460.856523:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144306432 00000100:00100000:1.0:1784938460.856530:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144306432 00000100:00100000:1.0:1784938460.856588:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784938460.856598:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3642:x1871643144306432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938460.856661:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3642:x1871643144306432:12345-0@lo:400:kworker.0 Request processed in 65us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938460.856668:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784938460.856795:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144306432:0@lo:400:kworker.0 00000100:00100000:2.0:1784938460.858636:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144306944:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938460.858655:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144307456:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938460.858673:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910bc587dc00 x1871643144307968/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938460.858685:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144307968:192.168.203.126@tcp:400:kworker.0 00010000:00010000:0.0:1784938461.471447:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784938461.863385:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5 00000001:00080000:1.0:1784938461.863413:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1784938461.902268:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938461.902490:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125341312 00000100:00100000:3.0:1784938461.902503:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125341312 00000100:00100000:3.0:1784938461.902615:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1784938461.902629:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:14999:x1871643125341312:12345-192.168.203.26@tcp:41:lfs.0 00000004:00000024:3.0:1784938461.902696:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784938461.902800:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:14999:x1871643125341312:12345-192.168.203.26@tcp:41:lfs.0 Request processed in 174us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938461.902809:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00080000:1.0:1784938461.904244:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938461.907950:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938461.908387:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125341440 00000100:00100000:1.0:1784938461.908402:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125341440 00000100:00080000:3.0:1784938461.908582:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938461.909138:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:1.0:1784938461.909156:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14999:x1871643125341440:12345-192.168.203.26@tcp:41:lfs.0 00000004:00000024:1.0:1784938461.909267:0:19429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784938461.909416:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14999:x1871643125341440:12345-192.168.203.26@tcp:41:lfs.0 Request processed in 266us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938461.909425:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:0.0:1784938461.917335:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938461.917791:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125341568 00000100:00100000:1.0:1784938461.917827:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125341568 00000100:00100000:1.0:1784938461.917986:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:1.0:1784938461.917999:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14999:x1871643125341568:12345-192.168.203.26@tcp:13:lfs.0 00002000:00000024:1.0:1784938461.918047:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784938461.918161:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:14999:x1871643125341568:12345-192.168.203.26@tcp:13:lfs.0 Request processed in 164us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938461.918170:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00080000:3.0:1784938461.922884:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938461.923085:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938461.923192:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125341696 00000100:00100000:1.0:1784938461.923206:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125341696 00000100:00100000:1.0:1784938461.923422:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1784938461.923434:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:14999:x1871643125341696:12345-192.168.203.26@tcp:13:lfs.0 00002000:00000024:1.0:1784938461.923478:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784938461.923648:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:14999:x1871643125341696:12345-192.168.203.26@tcp:13:lfs.0 Request processed in 214us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938461.923656:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00080000:3.0:1784938461.924363:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938462.082083:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938462.082315:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125341824 00000100:00100000:2.0:1784938462.082430:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125341824 00000100:00100000:2.0:1784938462.082511:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:2.0:1784938462.082523:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+10:15031:x1871643125341824:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784938462.082718:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938462.082746:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc97d0200/0x26783cd1c59ef8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28aa0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938462.082788:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d0200/0x26783cd1c59ef8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28aa0 expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938462.082802:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc97d0200/0x26783cd1c59ef8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28aa0 expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938462.082813:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0200, rc 0) 00000100:00100000:2.0:1784938462.082947:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15031:x1871643125341824:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 426us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.082956:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:0.0:1784938462.100872:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938462.101036:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125341952 00000100:00100000:3.0:1784938462.101050:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125341952 00000100:00100000:3.0:1784938462.101124:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:3.0:1784938462.101135:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15031:x1871643125341952:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784938462.103156:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15031:x1871643125341952:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 2006us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938462.103200:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:0.0:1784938462.117182:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938462.117758:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125342080 00000100:00100000:3.0:1784938462.117778:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125342080 00000100:00100000:3.0:1784938462.118934:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:3.0:1784938462.118959:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15031:x1871643125342080:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784938462.119182:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15031:x1871643125342080:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 233us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938462.119190:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:0.0:1784938462.131043:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938462.131474:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125342208 00000100:00100000:3.0:1784938462.131485:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125342208 00000100:00100000:3.0:1784938462.131674:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:3.0:1784938462.131687:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15038:x1871643125342208:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938462.131903:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15038:x1871643125342208:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 218us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938462.131913:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:2.0:1784938462.164129:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938462.168477:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125342336 00000100:00100000:3.0:1784938462.168499:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125342336 00000100:00100000:2.0:1784938462.173102:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:2.0:1784938462.173120:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd583850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15038:x1871643125342336:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938462.174413:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd583850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15038:x1871643125342336:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 1286us (10289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.174430:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:1.0:1784938462.196868:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938462.203813:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125342464 00000100:00100000:3.0:1784938462.203835:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125342464 00000100:00100000:1.0:1784938462.206925:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:1.0:1784938462.206952:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15038:x1871643125342464:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938462.207904:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15038:x1871643125342464:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 961us (11047us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938462.207916:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:0.0:1784938462.215811:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938462.216565:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125342592 00000100:00100000:2.0:1784938462.216586:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125342592 00000100:00100000:2.0:1784938462.218111:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:2.0:1784938462.218150:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:15031:x1871643125342592:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784938462.218354:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938462.218384:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cc97d1c00/0x26783cd1c59ef8e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28ad1 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938462.218425:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d1c00/0x26783cd1c59ef8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad1 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938462.218438:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cc97d1c00/0x26783cd1c59ef8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad1 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938462.218450:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1c00, rc 0) 00000100:00100000:2.0:1784938462.218623:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:15031:x1871643125342592:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 493us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.218632:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:2.0:1784938462.226559:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938462.226871:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125342720 00000100:00100000:1.0:1784938462.226887:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125342720 00000100:00100000:1.0:1784938462.226975:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:1.0:1784938462.226988:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:15031:x1871643125342720:12345-192.168.203.26@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784938462.227047:0:17131:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784938462.227076:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784938462.227082:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784938462.227086:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784938462.227089:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1784938462.227093:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1784938462.229071:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:15031:x1871643125342720:12345-192.168.203.26@tcp:256:mount.lustre.0 Request processed in 2070us (3508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.229104:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:0.0:1784938462.236436:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938462.236772:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125342848 00000100:00100000:3.0:1784938462.236788:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125342848 00000100:00100000:3.0:1784938462.236910:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:3.0:1784938462.236940:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:15031:x1871643125342848:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938462.236965:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938462.237002:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28ad8 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938462.237059:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad8 expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938462.237073:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad8 expref: 13 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938462.237209:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0600, rc 0) 00000100:00100000:3.0:1784938462.237314:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:15031:x1871643125342848:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 385us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938462.237322:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:1.0:1784938462.247052:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938462.247202:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125342976 00000100:00100000:2.0:1784938462.247246:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125342976 00000100:00100000:2.0:1784938462.247315:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:2.0:1784938462.247327:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:15031:x1871643125342976:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784938462.247541:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:15031:x1871643125342976:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 216us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.247560:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:1.0:1784938462.255778:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938462.255975:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125343104 00000100:00100000:3.0:1784938462.255992:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125343104 00000100:00100000:3.0:1784938462.256072:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:3.0:1784938462.256086:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:15031:x1871643125343104:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784938462.258426:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:15031:x1871643125343104:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 2325us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938462.258448:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:3.0:1784938462.270504:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938462.270750:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125343232 00000100:00100000:0.0:1784938462.270763:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125343232 00000100:00100000:0.0:1784938462.270840:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:0.0:1784938462.270853:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:15044:x1871643125343232:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938462.271080:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:15044:x1871643125343232:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 228us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938462.271088:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:1.0:1784938462.286061:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938462.286263:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125343360 00000100:00100000:0.0:1784938462.286277:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125343360 00000100:00100000:0.0:1784938462.286470:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:0.0:1784938462.286483:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:15044:x1871643125343360:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938462.288135:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:15044:x1871643125343360:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 1640us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938462.288164:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:1.0:1784938462.303187:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938462.303358:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938462.303940:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125343488 00000100:00100000:2.0:1784938462.303955:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125343488 00000100:00100000:2.0:1784938462.304010:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125343744 00000100:00100000:2.0:1784938462.304013:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125343744 00000100:00100000:2.0:1784938462.304045:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1784938462.304056:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1871643125343488:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784938462.304096:0:17140:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from 53ab7f31-238a-42f3-8d14-599fa1c9b387@192.168.203.26@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1784938462.304158:0:17140:0:(genops.c:1406:class_connect()) connect: client 53ab7f31-238a-42f3-8d14-599fa1c9b387, cookie 0x26783cd1c59ef8f5 00000004:00100000:2.0:1784938462.304195:0:17140:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784938462.304371:0:17140:0:(import.c:65:import_set_state_nolock()) ffff910cecbc3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938462.304461:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:2391:x1871643125343488:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 405us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.304469:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1784938462.304490:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:2.0:1784938462.304495:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1871643125343744:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784938462.304513:0:17140:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0001: connection from 53ab7f31-238a-42f3-8d14-599fa1c9b387@192.168.203.26@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1784938462.304570:0:17140:0:(genops.c:1406:class_connect()) connect: client 53ab7f31-238a-42f3-8d14-599fa1c9b387, cookie 0x26783cd1c59ef8fc 00000004:00100000:2.0:1784938462.304585:0:17140:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784938462.304639:0:17140:0:(import.c:65:import_set_state_nolock()) ffff910cecbc2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938462.308298:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:2391:x1871643125343744:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 3782us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.308317:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:2.0:1784938462.315440:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938462.315493:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938462.316006:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125344000 00000100:00100000:0.0:1784938462.316022:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125344000 00000100:00100000:0.0:1784938462.316119:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125343616 00000100:00100000:0.0:1784938462.316122:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125343616 00000100:00100000:0.0:1784938462.316153:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1784938462.316166:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+7:15031:x1871643125344000:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938462.316278:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784938462.316375:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+7:15031:x1871643125344000:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 211us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938462.316384:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1784938462.316405:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1784938462.316412:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:0:x1871643125343616:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938462.316425:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784938462.316448:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:0:x1871643125343616:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 36us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938462.316455:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00080000:1.0:1784938462.316698:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938462.318326:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938462.318409:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938462.318895:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125343872 00000100:00100000:2.0:1784938462.318909:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125343872 00000100:00100000:2.0:1784938462.318991:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125344128 00000100:00100000:2.0:1784938462.318994:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125344128 00000100:00100000:2.0:1784938462.319018:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1784938462.319028:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:0:x1871643125343872:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784938462.319086:0:17141:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784938462.319185:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:0:x1871643125343872:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 157us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.319193:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1784938462.319249:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1784938462.319256:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:15031:x1871643125344128:12345-192.168.203.26@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784938462.319289:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:15031:x1871643125344128:12345-192.168.203.26@tcp:40:mount.lustre.0 Request processed in 34us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.319296:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00080000:1.0:1784938462.319888:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784938462.327465:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938462.327516:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938462.327576:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938462.327828:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125344256 00000100:00100000:3.0:1784938462.327840:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125344256 00000100:00100000:3.0:1784938462.327885:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125344384 00000100:00100000:3.0:1784938462.327887:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125344384 00000100:00100000:3.0:1784938462.327906:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:3.0:1784938462.327915:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2391:x1871643125344256:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784938462.327959:0:18646:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 53ab7f31-238a-42f3-8d14-599fa1c9b387@192.168.203.26@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1784938462.328001:0:18646:0:(genops.c:1406:class_connect()) connect: client 53ab7f31-238a-42f3-8d14-599fa1c9b387, cookie 0x26783cd1c59ef903 00002000:00100000:3.0:1784938462.328016:0:18646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 53ab7f31-238a-42f3-8d14-599fa1c9b387/ffff910bc7c89800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784938462.328031:0:18646:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784938462.328175:0:18646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784938462.328264:0:18646:0:(import.c:65:import_set_state_nolock()) ffff910bc7c8f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938462.328481:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:0.0:1784938462.328491:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1871643125344384:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784938462.328519:0:18649:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 53ab7f31-238a-42f3-8d14-599fa1c9b387@192.168.203.26@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:0.0:1784938462.328558:0:18649:0:(genops.c:1406:class_connect()) connect: client 53ab7f31-238a-42f3-8d14-599fa1c9b387, cookie 0x26783cd1c59ef90a 00002000:00100000:0.0:1784938462.328565:0:18649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 53ab7f31-238a-42f3-8d14-599fa1c9b387/ffff910cdf4fb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784938462.328581:0:18649:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784938462.328649:0:18649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1784938462.330384:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125344512 00000100:00100000:1.0:1784938462.330399:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125344512 00000100:00100000:1.0:1784938462.330463:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1784938462.330472:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:15031:x1871643125344512:12345-192.168.203.26@tcp:900:mount.lustre.0 00000100:00080000:0.0:1784938462.330707:0:18649:0:(import.c:65:import_set_state_nolock()) ffff910cdf4f8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938462.330857:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:2391:x1871643125344256:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 2935us (3402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938462.330860:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:15031:x1871643125344512:12345-192.168.203.26@tcp:900:mount.lustre.0 Request processed in 384us (3339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938462.330884:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1784938462.330886:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1784938462.333901:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:2391:x1871643125344384:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 5387us (6302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938462.333948:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:1.0:1784938462.351882:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938462.358201:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125344640 00000100:00100000:2.0:1784938462.358247:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125344640 00000100:00100000:2.0:1784938462.358350:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1784938462.358384:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:15031:x1871643125344640:12345-192.168.203.26@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784938462.358773:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784938462.358928:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:15031:x1871643125344640:12345-192.168.203.26@tcp:33:mount.lustre.0 Request processed in 545us (7062us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938462.358937:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00010000:00010000:0.0:1784938462.495619:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938462.566338:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938462.567180:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125344768 00000100:00100000:0.0:1784938462.567196:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125344768 00000100:00100000:0.0:1784938462.567499:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1784938462.567511:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:15067:x1871643125344768:12345-192.168.203.26@tcp:101:mkdir.0 00010000:00010000:0.0:1784938462.567537:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938462.567587:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ef911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b09 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938462.567682:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938462.567701:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938462.567723:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938462.567785:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784938462.567789:0:17141:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938462.567813:0:17141:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938462.567842:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ef911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b09 expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938462.567865:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b09 expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938462.567890:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:0.0:1784938462.567893:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938462.567898:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77a00, rc 0) 00000100:00100000:0.0:1784938462.567988:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53ab7f31-238a-42f3-8d14-599fa1c9b387+7:15067:x1871643125344768:12345-192.168.203.26@tcp:101:mkdir.0 Request processed in 480us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938462.567996:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1784938462.883475:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938462.883513:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144308352:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:3.0:1784938462.883983:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938462.884157:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144308352 00000100:00100000:1.0:1784938462.884170:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144308352 00000100:00100000:1.0:1784938462.884297:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:1.0:1784938462.884308:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144308352:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:1.0:1784938462.884340:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784938462.884398:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144308352:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 92us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938462.884406:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 13 00000100:00100000:0.0:1784938462.884901:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144308352:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00080000:3.0:1784938462.884994:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784938463.521644:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938463.904107:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938463.904139:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144308480:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938463.905021:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938463.905090:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938463.905107:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144308608:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938463.905331:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938463.905361:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144308480 00000100:00100000:0.0:1784938463.905369:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144308480 00000100:00100000:0.0:1784938463.905422:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144308608 00000100:00100000:0.0:1784938463.905425:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144308608 00000100:00100000:0.0:1784938463.905443:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:0.0:1784938463.905452:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144308480:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:0.0:1784938463.905497:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784938463.905679:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144308480:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 226us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938463.905687:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 49 00000100:00100000:0.0:1784938463.905708:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:0.0:1784938463.905731:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144308608:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938463.905750:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784938463.905779:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144308608:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 49us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938463.905786:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 50 00000100:00100000:0.0:1784938463.906359:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144308608:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:0.0:1784938463.906405:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144308480:192.168.203.126@tcp:41:osp-pre-0-1.0 00010000:00010000:0.0:1784938464.544383:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784938464.929041:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 53ab7f31-238a-42f3-8d14-599fa1c9b387 00000001:00100000:2.0:1784938464.929058:0:17119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5 00000100:00100000:0.0:1784938464.930199:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144308736:192.168.203.126@tcp:13:osp-pre-0-0.0 00000001:00100000:1.0:1784938464.932277:0:18643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53ab7f31-238a-42f3-8d14-599fa1c9b387 00000001:00100000:1.0:1784938464.932296:0:18643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5 00000001:00100000:0.0:1784938464.932778:0:17871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 53ab7f31-238a-42f3-8d14-599fa1c9b387 00000001:00100000:0.0:1784938464.932786:0:17871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5 00000100:00100000:1.0:1784938464.933590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938464.933703:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144308736 00000100:00100000:0.0:1784938464.933717:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144308736 00000100:00100000:0.0:1784938464.933857:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00100000:0.0:1784938464.933870:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144308736:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938464.933913:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784938464.933997:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144308736:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 130us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938464.934006:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 14 00000100:00080000:1.0:1784938464.934060:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938464.934350:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144308736:192.168.203.126@tcp:13:osp-pre-0-0.0 00000001:02000400:0.0:1784938465.123360:0:20018:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1784938465.568709:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938465.953950:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938465.953977:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144308864:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938465.954176:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144308992:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938465.954478:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938465.954576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938465.954608:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144308864 00000100:00100000:2.0:1784938465.954616:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144308864 00000100:00100000:2.0:1784938465.954659:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144308992 00000100:00100000:2.0:1784938465.954663:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144308992 00000100:00100000:2.0:1784938465.954681:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:2.0:1784938465.954690:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144308864:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938465.954720:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784938465.954772:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1871643144308864:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938465.954780:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:2.0:1784938465.954799:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:2.0:1784938465.954805:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144308992:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938465.954815:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784938465.954840:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144308992:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 34us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938465.954855:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00080000:2.0:1784938465.954875:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938465.955013:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144308992:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:2.0:1784938465.955025:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1784938465.955041:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1871643144308864:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938465.955312:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144309248:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955361:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144309760:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955386:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144310272:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955415:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784938465.955423:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144309120:0@lo:400:kworker.0 00000100:00100000:1.0:1784938465.955455:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938465.955481:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144309632:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955530:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144310144:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955559:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144309376:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955583:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144309888:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955604:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144310400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955624:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784938465.955629:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144309504:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955647:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144310016:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.955675:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144309120 00000100:00100000:1.0:1784938465.955680:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144309120 00000100:00100000:1.0:1784938465.955710:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784938465.955716:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3641:x1871643144309120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938465.955756:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3641:x1871643144309120:12345-0@lo:400:kworker.0 Request processed in 40us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938465.955762:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784938465.955798:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144309120:0@lo:400:kworker.0 00000100:00100000:2.0:1784938465.956005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938465.956137:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938465.956161:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938465.956188:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144309248 00000100:00100000:1.0:1784938465.956192:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144309248 00000100:00100000:1.0:1784938465.956239:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 51 00000100:00100000:1.0:1784938465.956247:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144309248:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.956281:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144309248:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938465.956293:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 51 00000100:00100000:1.0:1784938465.956313:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144309760 00000100:00100000:1.0:1784938465.956317:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144309760 00000100:00100000:1.0:1784938465.956349:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:1.0:1784938465.956354:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144309760:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938465.956379:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144309760:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938465.956384:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 9 00000100:00100000:2.0:1784938465.956473:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00080000:2.0:1784938465.956631:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938465.956640:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938465.956678:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144309888 00000100:00100000:0.0:1784938465.956681:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144309888 00000100:00100000:0.0:1784938465.956707:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144309504 00000100:00100000:0.0:1784938465.956710:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144309504 00000100:00100000:0.0:1784938465.956727:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:0.0:1784938465.956734:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144309888:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938465.956766:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1871643144309888:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938465.956772:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 42 00000100:00100000:0.0:1784938465.956786:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:0.0:1784938465.956792:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144309504:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938465.956814:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1871643144309504:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938465.956819:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 43 00000100:00100000:2.0:1784938465.956915:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938465.956963:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938465.956981:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938465.957001:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938465.957002:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144309376 00000100:00100000:3.0:1784938465.957006:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144309376 00000100:00100000:2.0:1784938465.957017:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938465.957031:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:3.0:1784938465.957037:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144309376:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957051:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144309632 00000100:00100000:2.0:1784938465.957055:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144309632 00000100:00100000:3.0:1784938465.957069:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144309376:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 33us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938465.957075:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 10 00000100:00100000:2.0:1784938465.957077:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:2.0:1784938465.957083:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144309632:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957108:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144309632:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 25us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938465.957115:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:2.0:1784938465.957131:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144310272 00000100:00100000:2.0:1784938465.957135:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144310272 00000100:00100000:2.0:1784938465.957154:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144310144 00000100:00100000:2.0:1784938465.957157:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144310144 00000100:00100000:2.0:1784938465.957182:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144310400 00000100:00100000:2.0:1784938465.957185:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144310400 00000100:00100000:2.0:1784938465.957195:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144310016 00000100:00100000:2.0:1784938465.957197:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144310016 00000100:00100000:2.0:1784938465.957210:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:2.0:1784938465.957256:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144310272:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957280:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1871643144310272:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938465.957285:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 44 00000100:00100000:2.0:1784938465.957296:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:2.0:1784938465.957301:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144310144:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957317:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1871643144310144:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 17us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938465.957323:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 45 00000100:00100000:2.0:1784938465.957331:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:2.0:1784938465.957336:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144310400:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957364:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1871643144310400:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 16us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938465.957369:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 46 00000100:00100000:2.0:1784938465.957379:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00100000:2.0:1784938465.957385:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144310016:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957406:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144310016:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938465.957412:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 47 00000100:00080000:2.0:1784938465.957429:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938465.957438:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938465.957466:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1871643144309504:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957479:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1871643144309888:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938465.957492:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2048000 x1871643144310400/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938465.957502:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1871643144310400:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957536:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144309376:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957551:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144310016:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957580:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144309632:192.168.203.126@tcp:400:kworker.0 00010000:00080000:2.0:1784938465.957591:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cd2049f80 x1871643144310144/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938465.957600:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1871643144310144:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957610:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144309248:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957621:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144309760:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938465.957631:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1871643144310272:192.168.203.126@tcp:400:kworker.0 00000040:00080000:3.0:1784938466.026131:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784938466.591433:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938467.447569:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938467.447615:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938467.447718:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125345280 00000100:00100000:1.0:1784938467.447729:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125345280 00000100:00100000:1.0:1784938467.447809:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:1.0:1784938467.447821:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2393:x1871643125345280:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938467.447893:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2393:x1871643125345280:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 74us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938467.447900:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00080000:1.0:1784938467.447923:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938467.448200:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125345024 00000100:00100000:0.0:1784938467.448206:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125345024 00000100:00100000:0.0:1784938467.448282:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:0.0:1784938467.448291:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:2393:x1871643125345024:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938467.448328:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:2393:x1871643125345024:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 39us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938467.448334:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1784938467.448565:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938467.448593:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00080000:1.0:1784938467.449084:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938467.449295:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938467.449332:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938467.449355:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938467.449372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938467.449390:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938467.449412:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125345792 00000100:00100000:3.0:1784938467.449425:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125345792 00000100:00100000:3.0:1784938467.449460:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125345408 00000100:00100000:0.0:1784938467.449577:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125345536 00000100:00100000:0.0:1784938467.449582:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125345536 00000100:00100000:0.0:1784938467.449608:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125345152 00000100:00100000:0.0:1784938467.449611:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125345152 00000100:00100000:0.0:1784938467.449650:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125345664 00000100:00100000:0.0:1784938467.449654:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125345664 00000100:00100000:0.0:1784938467.449671:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:0.0:1784938467.449679:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:2393:x1871643125345536:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938467.449729:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:2393:x1871643125345536:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 51us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938467.449736:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:0.0:1784938467.449751:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1784938467.449757:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2393:x1871643125345152:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938467.449795:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2393:x1871643125345152:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 37us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938467.449802:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1784938467.449814:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:0.0:1784938467.449820:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2393:x1871643125345664:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1784938467.449846:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2393:x1871643125345664:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938467.449852:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:1.0:1784938467.450199:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125344896 00000100:00100000:1.0:1784938467.450204:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125344896 00000100:00100000:1.0:1784938467.450248:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:1.0:1784938467.450255:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:2393:x1871643125344896:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938467.450284:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:2393:x1871643125344896:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 31us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938467.450291:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:3.0:1784938467.451387:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125345408 00000100:00100000:3.0:1784938467.451416:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125345920 00000100:00100000:3.0:1784938467.451418:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125345920 00000100:00100000:3.0:1784938467.451489:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1784938467.451496:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2393:x1871643125345792:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938467.451639:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2393:x1871643125345792:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 136us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938467.451647:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1784938467.451662:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:3.0:1784938467.451668:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2393:x1871643125345408:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938467.451693:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2393:x1871643125345408:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938467.451699:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:3.0:1784938467.451709:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1784938467.451716:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:2393:x1871643125345920:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938467.451762:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:2393:x1871643125345920:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 46us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938467.451777:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00080000:3.0:1784938467.451805:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938467.451809:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784938467.451812:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938467.451814:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784938467.623396:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784938467.969456:0:20166:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe103c9970 20000000:00000080:1.0:1784938467.969481:0:20166:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910cecbeb400 uarg=0000000000000000 20000000:01000000:1.0:1784938467.974585:0:20166:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938467.974594:0:20166:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938467.974599:0:20166:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784938467.977017:0:20167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1784938467.977183:0:20166:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784938467.994821:0:20166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784938467.995738:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995761:0:20166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef5ad expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995785:0:20166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef5bb expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995792:0:20166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef5fa expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995799:0:20166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef75f expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995808:0:20166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a68 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995815:0:20166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad8 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995823:0:20166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995861:0:20166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad8 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995876:0:20166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad8 expref: 12 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938467.995891:0:20166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144310528:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938467.995986:0:20166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a68 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.995995:0:20166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a68 expref: 12 pid: 17131 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938467.996010:0:20166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144310656:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938467.996039:0:20166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef75f expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.996046:0:20166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef75f expref: 23 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938467.996055:0:20166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd458000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144310784:0@lo:104: 00000100:00100000:2.0:1784938467.996090:0:20166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938467.996136:0:20166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef5fa expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.996144:0:20166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef5fa expref: 23 pid: 17134 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938467.996151:0:20166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd45b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144310912:0@lo:104: 00000100:00100000:2.0:1784938467.996171:0:20166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938467.996202:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144310784 00000100:00100000:2.0:1784938467.996208:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144310784 00000100:00100000:2.0:1784938467.996259:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144310912 00000100:00100000:2.0:1784938467.996262:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144310912 00000100:00100000:2.0:1784938467.996274:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938467.996280:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:20166:x1871643144310784:12345-0@lo:104: 00010000:00010000:2.0:1784938467.996292:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.998657:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938467.998675:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:20166:x1871643144310784:12345-0@lo:104: Request processed in 2389us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938467.998698:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938467.998742:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1784938467.998752:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784938467.998753:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:20166:x1871643144310912:12345-0@lo:104: 00010000:00010000:3.0:1784938467.998760:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.998772:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998780:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76200 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938467.998784:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998792:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938467.998798:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938467.998803:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938467.998840:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.998843:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1784938467.998847:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784938467.998848:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:20166:x1871643144310912:12345-0@lo:104: Request processed in 99us (2677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938467.998853:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1784938467.998868:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998874:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910ce6b76200/0x26783cd1c59ef75f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef766 expref: -99 pid: 19462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998886:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938467.998889:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998894:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1e00 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:3.0:1784938467.998897:0:17128:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998912:0:17128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938467.998918:0:17128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.998922:0:20166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef5bb expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938467.998924:0:17128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938467.998933:0:20166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef5bb expref: 23 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998935:0:17128:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998941:0:17128:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784938467.998946:0:20166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144311168:0@lo:104: 00010000:00010000:3.0:1784938467.998955:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998961:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cffbc1e00/0x26783cd1c59ef5fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef601 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.998969:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938467.998971:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938467.998972:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938467.998977:0:20166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938467.998983:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144311040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938467.999004:0:20166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x26783cd1c59ef5ad expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938467.999009:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938467.999013:0:20166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x26783cd1c59ef5ad expref: 23 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938467.999021:0:20166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144311424:0@lo:104: 00000100:00100000:2.0:1784938467.999038:0:20166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938467.999043:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938467.999051:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144311296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938467.999057:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144311168 00000100:00100000:2.0:1784938467.999063:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144311168 00000100:00100000:3.0:1784938467.999070:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938467.999092:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144311424 00000100:00100000:2.0:1784938467.999095:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144311424 00000100:00100000:3.0:1784938467.999096:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144311040 00000100:00100000:3.0:1784938467.999098:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144311040 00000100:00100000:2.0:1784938467.999105:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784938467.999110:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:20166:x1871643144311168:12345-0@lo:104: 00010000:00010000:3.0:1784938467.999112:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef75f expref: 24 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.999117:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938467.999139:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144311296 00000100:00100000:3.0:1784938467.999143:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144311296 00010000:00010000:2.0:1784938467.999147:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938467.999152:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+4:20166:x1871643144311168:12345-0@lo:104: Request processed in 42us (174us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938467.999154:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef5fa expref: 25 pid: 17134 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938467.999158:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784938467.999170:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938467.999171:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938467.999176:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd565180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+25:3643:x1871643144311040:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938467.999176:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:20166:x1871643144311424:12345-0@lo:104: 00010000:00010000:2.0:1784938467.999183:0:17123:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.999185:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938467.999189:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef75f expref: 25 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.999197:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef75f expref: 25 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.999208:0:17123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784938467.999231:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+3:20166:x1871643144311424:12345-0@lo:104: Request processed in 37us (174us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938467.999234:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938467.999237:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1784938467.999252:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938467.999257:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938467.999261:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd565180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+25:3643:x1871643144311040:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (251us total) trans 0 rc 0/0 00010000:00010000:2.0:1784938467.999264:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc1800 already unused, calling callback (ffffffffc14f4c20) 00000100:00100000:3.0:1784938467.999267:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 10000000:00010000:2.0:1784938467.999267:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.999275:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938467.999279:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938467.999284:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3641:x1871643144311296:12345-0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1784938467.999286:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.999291:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:2.0:1784938467.999291:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938467.999294:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef5fa expref: 24 pid: 17134 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938467.999302:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef5fa expref: 24 pid: 17134 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.999304:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.999310:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938467.999311:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938467.999319:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938467.999337:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3641:x1871643144311296:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (266us total) trans 0 rc 0/0 00010000:00010000:2.0:1784938467.999341:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cffbc1800/0x26783cd1c59ef5bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef5c2 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938467.999343:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1784938467.999350:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938467.999353:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.999358:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cffbc0400 already unused, calling callback (ffffffffc14f4c20) 10000000:00010000:2.0:1784938467.999361:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.999367:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938467.999372:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144311552:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1784938467.999374:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938467.999378:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1784938467.999392:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938467.999396:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.999402:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938467.999410:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938467.999415:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff910cffbc0400/0x26783cd1c59ef5ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x26783cd1c59ef5b4 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938467.999418:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144311296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938467.999428:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938467.999429:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938467.999431:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938467.999438:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144311680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938467.999440:0:20166:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1784938467.999522:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938467.999700:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cffbc1400/0x26783cd1c59ef766 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef75f expref: 23 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938467.999713:0:20166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144310784:0@lo:104: 00000100:00100000:3.0:1784938468.000300:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938468.000385:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144311552 00000100:00100000:3.0:1784938468.000391:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144311552 00010000:00010000:3.0:1784938468.000415:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef5bb expref: 23 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938468.000435:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144311680 00000100:00100000:3.0:1784938468.000437:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144311680 00010000:00010000:3.0:1784938468.000446:0:17126:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef5ad expref: 24 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938468.000462:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784938468.000469:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3641:x1871643144311552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938468.000480:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938468.000485:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef5bb expref: 24 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938468.000494:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef5bb expref: 24 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938468.000662:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d020d1600/0x26783cd1c59ef601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef5fa expref: 24 pid: 17134 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938468.000674:0:20166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd45b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144310912:0@lo:104: 00000100:00100000:2.0:1784938468.000716:0:20166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144311168:0@lo:104: 00000100:00100000:2.0:1784938468.000725:0:20166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144311424:0@lo:104: 00000100:00100000:2.0:1784938468.000736:0:20166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144310528:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938468.000744:0:20166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd458700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20166:1871643144310656:192.168.203.26@tcp:104: 00010000:00010000:3.0:1784938468.000966:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b76800/0x26783cd1c59ef5c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef5bb expref: 23 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938468.000988:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938468.000989:0:20166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938468.001038:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:3641:x1871643144311552:12345-0@lo:103:ldlm_bl.0 Request processed in 569us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938468.001046:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784938468.001053:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3641:1871643144311552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938468.001063:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938468.001081:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:3642:x1871643144311680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938468.001092:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938468.001098:0:17126:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x26783cd1c59ef5ad expref: 21 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938468.001102:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1784938468.001111:0:17126:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x26783cd1c59ef5ad expref: 21 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938468.001118:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144311808:192.168.203.126@tcp:13:osp-pre-0-1.0 00010000:00010000:3.0:1784938468.001125:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910ce6b77c00/0x26783cd1c59ef5b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x26783cd1c59ef5ad expref: 21 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938468.001136:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938468.001167:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:3642:x1871643144311680:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938468.001173:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784938468.001238:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3642:1871643144311680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938468.001256:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144311040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938468.001273:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938468.001527:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938468.001581:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144311808 00000100:00100000:3.0:1784938468.001586:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144311808 00000100:00100000:3.0:1784938468.001635:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:3.0:1784938468.001643:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144311808:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:3.0:1784938468.001681:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784938468.001758:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144311808:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 115us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938468.001765:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00080000:3.0:1784938468.001786:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938468.001967:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910bc587c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144311808:192.168.203.126@tcp:13:osp-pre-0-1.0 00000001:00100000:1.0:1784938468.002088:0:19463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 53ab7f31-238a-42f3-8d14-599fa1c9b387 00000100:00100000:3.0:1784938468.005601:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938468.005707:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938468.005909:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125346176 00000100:00100000:1.0:1784938468.005918:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125346176 00010000:00010000:1.0:1784938468.005957:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a68 expref: 13 pid: 17131 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938468.005988:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125346048 00000100:00100000:1.0:1784938468.005991:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125346048 00010000:00010000:1.0:1784938468.006005:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad8 expref: 14 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938468.006034:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:1.0:1784938468.006044:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc6768850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+14:2392:x1871643125346176:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938468.006059:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938468.006064:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a68 expref: 14 pid: 17131 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006075:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a68 expref: 14 pid: 17131 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006093:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc97d0600/0x26783cd1c59ef8af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a68 expref: 14 pid: 17131 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006126:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938468.006180:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc6768850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:2392:x1871643125346176:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 137us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938468.006188:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:1.0:1784938468.006262:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:1.0:1784938468.006270:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd564700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:2392:x1871643125346048:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938468.006278:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938468.006283:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad8 expref: 12 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006291:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad8 expref: 12 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006300:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cfd1a0600/0x26783cd1c59ef8ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ad8 expref: 12 pid: 17133 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006309:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006317:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006330:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006337:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006353:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006360:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006366:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0a00 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:1.0:1784938468.006370:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006379:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006391:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938468.006402:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938468.006423:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd564700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:2392:x1871643125346048:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 153us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938468.006429:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00010000:00010000:2.0:1784938468.006675:0:20166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938468.006684:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938468.006691:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910cc97d0a00/0x26783cd1c59ef91f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938468.645286:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938469.024168:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144311936:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938469.024809:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938469.025112:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144311936 00000100:00100000:0.0:1784938469.025120:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144311936 00000100:00100000:0.0:1784938469.025179:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:0.0:1784938469.025198:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144311936:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:0.0:1784938469.025250:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784938469.025335:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144311936:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 146us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938469.025353:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:2.0:1784938469.026444:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144311936:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:2.0:1784938469.026590:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144312064:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938469.026736:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938469.026758:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144312064 00000100:00100000:2.0:1784938469.026763:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144312064 00000100:00100000:2.0:1784938469.026799:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:2.0:1784938469.026807:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144312064:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:2.0:1784938469.026835:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784938469.026870:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144312064:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938469.026886:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:1.0:1784938469.027096:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144312064:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:2.0:1784938469.625648:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938469.627468:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125346304 00000100:00100000:3.0:1784938469.627480:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125346304 00000100:00100000:3.0:1784938469.627550:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:3.0:1784938469.627559:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+11:14914:x1871643125346304:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938469.627574:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938469.627594:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a1000/0x26783cd1c59ef926 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b10 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.627622:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a1000/0x26783cd1c59ef926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b10 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.627632:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a1000/0x26783cd1c59ef926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b10 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.627641:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1000, rc 0) 00000100:00100000:3.0:1784938469.627703:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:14914:x1871643125346304:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 145us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938469.627710:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:0.0:1784938469.630338:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938469.630414:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125346432 00000100:00100000:2.0:1784938469.630425:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125346432 00000100:00100000:2.0:1784938469.630481:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:2.0:1784938469.630491:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:14914:x1871643125346432:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.630660:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:14914:x1871643125346432:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 169us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938469.630668:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:2.0:1784938469.643418:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938469.643533:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125346560 00000100:00100000:0.0:1784938469.643543:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125346560 00000100:00100000:0.0:1784938469.643595:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:0.0:1784938469.643604:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:14914:x1871643125346560:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938469.643735:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:14914:x1871643125346560:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 132us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938469.643743:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:0.0:1784938469.663372:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938469.663535:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125346688 00000100:00100000:3.0:1784938469.663546:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125346688 00000100:00100000:3.0:1784938469.663609:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 149 00010000:00010000:2.0:1784938469.663612:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938469.663620:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+12:14914:x1871643125346688:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938469.663640:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938469.663657:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0000/0x26783cd1c59ef92d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b17 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.663684:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0000/0x26783cd1c59ef92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b17 expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.663696:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0000/0x26783cd1c59ef92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b17 expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.663705:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0000, rc 0) 00000100:00100000:3.0:1784938469.663765:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:14914:x1871643125346688:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 148us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938469.663773:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:2.0:1784938469.668640:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938469.672281:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125346816 00000100:00100000:1.0:1784938469.672295:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125346816 00000100:00100000:1.0:1784938469.672418:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:1.0:1784938469.672427:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:14914:x1871643125346816:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938469.672592:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:14914:x1871643125346816:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 165us (3962us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938469.672609:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:2.0:1784938469.674557:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938469.678919:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125346944 00000100:00100000:3.0:1784938469.678934:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125346944 00000100:00100000:2.0:1784938469.684424:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:2.0:1784938469.684436:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:14914:x1871643125346944:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.684590:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:14914:x1871643125346944:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 155us (10038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938469.684599:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 151 10000000:01000000:2.0:1784938469.727328:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938469.727336:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910bc6579000 from 13 10000000:01000000:2.0:1784938469.727342:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938469.727392:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d1e00/0x26783cd1c59ef934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938469.727404:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cc97d1e00/0x26783cd1c59ef934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938469.727444:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cc97d1e00/0x26783cd1c59ef934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938469.727471:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.727623:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938469.727670:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938469.727730:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144312192 00000100:00100000:1.0:1784938469.727737:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144312192 00000100:00100000:1.0:1784938469.727803:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784938469.727811:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+20:17136:x1871643144312192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938469.727888:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938469.727902:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d0c00/0x26783cd1c59ef93b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef934 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938469.727926:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d0c00/0x26783cd1c59ef93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef934 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938469.727937:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d0c00/0x26783cd1c59ef93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef934 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938469.727946:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d0c00, rc 0) 00000100:00100000:1.0:1784938469.731627:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:17136:x1871643144312192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3807us (3994us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938469.731638:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784938469.738556:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938469.738589:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cc97d1e00/0x26783cd1c59ef934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef93b expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.738601:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cc97d1e00/0x26783cd1c59ef934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef93b expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938469.738911:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.738993:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938469.739040:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938469.739105:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144312320 00000100:00100000:2.0:1784938469.739113:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144312320 00000100:00100000:2.0:1784938469.739170:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784938469.739179:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:17136:x1871643144312320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.739338:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:17136:x1871643144312320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938469.739346:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784938469.739600:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.739645:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.739689:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938469.739718:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5ea840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938469.740005:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144312448 00000100:00100000:1.0:1784938469.740011:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144312448 00000100:00100000:1.0:1784938469.740053:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784938469.740061:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:17136:x1871643144312448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938469.740158:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:17136:x1871643144312448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938469.740165:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784938469.740549:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784938469.742291:0:20245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784938469.742959:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784938469.742988:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938469.743000:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d1e00/0x26783cd1c59ef934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef93b expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.743012:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cc97d1e00/0x26783cd1c59ef934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef93b expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938469.743022:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938469.743025:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cdf54e800 from 13 10000000:01000000:3.0:1784938469.743027:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938469.743068:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ef942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.743075:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ef942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.743085:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ef942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938469.743108:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.743184:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938469.743261:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938469.743328:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144312576 00000100:00100000:0.0:1784938469.743335:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144312576 00000100:00100000:0.0:1784938469.743380:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784938469.743388:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+21:17136:x1871643144312576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938469.743402:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938469.743415:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ef949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef942 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938469.743439:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ef949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef942 expref: 22 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938469.743451:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910ce6b76e00/0x26783cd1c59ef949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef942 expref: 22 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938469.743459:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76e00, rc 0) 00000100:00100000:0.0:1784938469.743515:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:17136:x1871643144312576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938469.743531:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784938469.743704:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938469.743718:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ef942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef949 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.743727:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ef942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef949 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938469.743785:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.743813:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938469.743854:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938469.743915:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144312704 00000100:00100000:2.0:1784938469.743921:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144312704 00000100:00100000:2.0:1784938469.743963:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784938469.743971:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:17136:x1871643144312704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.744077:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:17136:x1871643144312704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938469.744084:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784938469.744168:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.744195:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.744250:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938469.744272:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cfd5ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938469.744285:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144312832 00000100:00100000:3.0:1784938469.744289:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144312832 00000100:00100000:3.0:1784938469.744306:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784938469.744312:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:17136:x1871643144312832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.744388:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:17136:x1871643144312832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938469.744394:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784938469.744511:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784938469.745201:0:20246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784938469.745717:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784938469.745742:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938469.745751:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ef942 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef949 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938469.745761:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cfd1a0400/0x26783cd1c59ef942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef949 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938469.745772:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938469.745774:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910bc7112800 from 13 10000000:01000000:1.0:1784938469.745777:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938469.745808:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1400/0x26783cd1c59ef950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938469.745815:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910d020d1400/0x26783cd1c59ef950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938469.745825:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910d020d1400/0x26783cd1c59ef950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938469.745855:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938469.745907:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938469.745940:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938469.746246:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144312960 00000100:00100000:3.0:1784938469.746253:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144312960 00000100:00100000:1.0:1784938469.746511:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784938469.746522:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+22:17136:x1871643144312960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938469.746536:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938469.746550:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d020d1800/0x26783cd1c59ef957 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef950 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938469.746574:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d020d1800/0x26783cd1c59ef957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef950 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938469.746598:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d020d1800/0x26783cd1c59ef957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef950 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938469.746607:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d020d1800, rc 0) 00000100:00100000:1.0:1784938469.746668:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144312960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938469.746675:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784938469.746775:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144312960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938469.746790:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910d020d1400/0x26783cd1c59ef950 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef957 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938469.746805:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910d020d1400/0x26783cd1c59ef950 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef957 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938469.746885:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.746917:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938469.746952:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938469.746971:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144313088 00000100:00100000:0.0:1784938469.746977:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144313088 00000100:00100000:0.0:1784938469.747011:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784938469.747019:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144313088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938469.747151:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144313088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938469.747158:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784938469.747330:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.747359:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.747400:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938469.747428:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938469.747541:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144313216 00000100:00100000:0.0:1784938469.747547:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144313216 00000100:00100000:0.0:1784938469.747576:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784938469.747583:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144313216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938469.747676:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144313216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938469.747683:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784938469.747757:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784938469.749268:0:20247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784938469.749508:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784938469.749533:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938469.749543:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910d020d1400/0x26783cd1c59ef950 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef957 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938469.749555:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910d020d1400/0x26783cd1c59ef950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef957 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938469.749565:0:17136:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938469.749568:0:17136:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff910cc871e000 from 13 10000000:01000000:2.0:1784938469.749571:0:17136:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938469.749606:0:17136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d1600/0x26783cd1c59ef95e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938469.749614:0:17136:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff910cc97d1600/0x26783cd1c59ef95e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938469.749624:0:17136:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff910cc97d1600/0x26783cd1c59ef95e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938469.749670:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.749728:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938469.749764:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938469.750423:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144313344 00000100:00100000:3.0:1784938469.750761:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144313344 00000100:00100000:3.0:1784938469.750819:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784938469.750828:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+23:17136:x1871643144313344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938469.750845:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938469.750861:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910cfd1a0a00/0x26783cd1c59ef965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x26783cd1c59ef95e expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.750885:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910cfd1a0a00/0x26783cd1c59ef965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x26783cd1c59ef95e expref: 24 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.750896:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910cfd1a0a00/0x26783cd1c59ef965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x26783cd1c59ef95e expref: 24 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.750905:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0a00, rc 0) 00000100:00100000:3.0:1784938469.750963:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:17136:x1871643144313344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938469.750970:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784938469.751842:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938469.751862:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff910cc97d1600/0x26783cd1c59ef95e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef965 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938469.751873:0:17136:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff910cc97d1600/0x26783cd1c59ef95e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x26783cd1c59ef965 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938469.751945:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.751990:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938469.752022:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938469.752038:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144313472 00000100:00100000:2.0:1784938469.752042:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144313472 00000100:00100000:2.0:1784938469.752071:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784938469.752077:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:17136:x1871643144313472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.752197:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:17136:x1871643144313472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938469.752205:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784938469.752269:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.752297:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938469.752336:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938469.752348:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd0987f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938469.753025:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144313600 00000100:00100000:3.0:1784938469.753033:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144313600 00000100:00100000:3.0:1784938469.753083:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784938469.753091:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:17136:x1871643144313600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938469.753191:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:17136:x1871643144313600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938469.753197:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784938469.753310:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:17136:1871643144313600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784938469.757134:0:20249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784938469.757734:0:17136:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784938469.757759:0:17136:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938469.757781:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff910cc97d1600/0x26783cd1c59ef95e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef965 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938469.757792:0:17136:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff910cc97d1600/0x26783cd1c59ef95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x26783cd1c59ef965 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938469.985156:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784938470.047907:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144313728:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938470.048150:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938470.049819:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144313728 00000100:00100000:3.0:1784938470.049833:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144313728 00000100:00100000:3.0:1784938470.049891:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:3.0:1784938470.049900:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144313728:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938470.049930:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784938470.049994:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144313728:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 94us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938470.050001:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00080000:3.0:1784938470.050025:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938470.050210:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144313728:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:3.0:1784938470.687700:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938471.071699:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144313984:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.071794:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144314496:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.071831:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144315008:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.071860:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784938471.071866:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144314112:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.071885:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144314624:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.071903:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144315136:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.072135:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938471.072210:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938471.072264:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938471.072311:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938471.072327:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144313984 00000100:00100000:1.0:1784938471.072335:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938471.072336:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144313984 00000100:00100000:1.0:1784938471.072360:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938471.072384:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144314496 00000100:00100000:2.0:1784938471.072389:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144314496 00000100:00100000:1.0:1784938471.072392:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:1.0:1784938471.072405:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144313984:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.072411:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:2.0:1784938471.072421:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144314496:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.072478:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144313984:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 76us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.072499:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144314496:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.072501:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:2.0:1784938471.072512:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:1.0:1784938471.072533:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144315008 00000100:00100000:1.0:1784938471.072538:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144315008 00000100:00100000:1.0:1784938471.072574:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144315136 00000100:00100000:1.0:1784938471.072577:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144315136 00000100:00100000:1.0:1784938471.072604:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:1.0:1784938471.072611:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144315008:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.072641:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1871643144315008:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.072648:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 52 00000100:00100000:1.0:1784938471.072665:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:1.0:1784938471.072673:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144315136:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.072699:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1871643144315136:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.072706:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 53 00000100:00100000:1.0:1784938471.072730:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144315648:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938471.073255:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144313856:0@lo:400:kworker.0 00000100:00100000:0.0:1784938471.073586:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144314240:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.073922:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938471.073931:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144315520:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938471.076797:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00080000:2.0:1784938471.076896:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938471.076902:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938471.076933:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144314112 00000100:00100000:2.0:1784938471.076942:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144314112 00000100:00100000:2.0:1784938471.077000:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144314624 00000100:00100000:2.0:1784938471.077004:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144314624 00000100:00100000:2.0:1784938471.077035:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:2.0:1784938471.077044:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144314112:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938471.077229:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144314752:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.077600:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144314112:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 554us (5287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.077609:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 15 00000100:00100000:2.0:1784938471.077629:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00100000:2.0:1784938471.077637:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144314624:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.077687:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144314624:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 51us (5352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.077694:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 16 00000100:00080000:2.0:1784938471.077714:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938471.077750:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144315648 00000100:00100000:2.0:1784938471.077754:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144315648 00000100:00100000:0.0:1784938471.077763:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144315264:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.077787:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00100000:2.0:1784938471.077795:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144315648:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938471.077845:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784938471.077881:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144315648:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 87us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.077888:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 19 00000100:00080000:2.0:1784938471.077912:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784938471.077995:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb76a00 x1871643144315136/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938471.078010:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1871643144315136:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.078023:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144313984:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.078034:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144314496:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.078045:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1871643144315008:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938471.088897:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938471.088957:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd204a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144314368:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938471.088995:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144314880:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938471.089018:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144315392:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938471.089062:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144313856 00000100:00100000:3.0:1784938471.089069:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144313856 00000100:00100000:3.0:1784938471.089125:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784938471.089133:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3643:x1871643144313856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938471.089188:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3643:x1871643144313856:12345-0@lo:400:kworker.0 Request processed in 55us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938471.089194:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784938471.090579:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938471.090773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938471.090819:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938471.090855:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938471.090880:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144314240 00000100:00100000:1.0:1784938471.090887:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144314240 00000100:00100000:1.0:1784938471.090948:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144314752 00000100:00100000:1.0:1784938471.090951:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144314752 00000100:00100000:1.0:1784938471.090974:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:1.0:1784938471.090983:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144314240:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.091044:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144314240:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 63us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.091051:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 17 00000100:00100000:1.0:1784938471.091068:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:1.0:1784938471.091076:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cec182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144314752:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.091089:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144315520 00000100:00100000:2.0:1784938471.091095:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144315520 00000100:00100000:1.0:1784938471.091103:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cec182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144314752:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 28us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.091111:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 18 00000100:00100000:2.0:1784938471.091129:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00100000:2.0:1784938471.091139:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144315520:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938471.091164:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784938471.091290:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1871643144315520:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 153us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.091297:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 20 00000100:00080000:1.0:1784938471.091309:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938471.091366:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938471.091397:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938471.091413:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144315264 00000100:00100000:2.0:1784938471.091417:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144315264 00000100:00100000:2.0:1784938471.091446:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144314368 00000100:00100000:2.0:1784938471.091449:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144314368 00000100:00100000:2.0:1784938471.091460:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144314880 00000100:00100000:2.0:1784938471.091462:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144314880 00000100:00100000:2.0:1784938471.091474:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:2.0:1784938471.091479:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144315264:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.091519:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1871643144315264:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 38us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.091526:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 54 00000100:00100000:2.0:1784938471.091541:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:2.0:1784938471.091547:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144314368:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.091569:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1871643144314368:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 23us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.091575:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 55 00000100:00100000:2.0:1784938471.091586:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:2.0:1784938471.091591:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144314880:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.091672:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1871643144314880:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.091686:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 56 00000100:00100000:3.0:1784938471.091779:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3643:1871643144313856:0@lo:400:kworker.0 00000100:00100000:3.0:1784938471.091911:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144314112:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938471.091922:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144314624:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.092036:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938471.092346:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144315392 00000100:00100000:2.0:1784938471.092351:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144315392 00000100:00100000:2.0:1784938471.092382:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00100000:2.0:1784938471.092388:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144315392:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.092425:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1871643144315392:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 36us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.092431:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00080000:2.0:1784938471.092523:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938471.092527:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938471.092558:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1871643144315520:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938471.092575:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144315648:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:3.0:1784938471.093505:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd204a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1871643144314368:192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938471.093522:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1871643144314880:192.168.203.126@tcp:400:kworker.0 00010000:00080000:3.0:1784938471.093537:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cffb74000 x1871643144315392/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938471.093548:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1871643144315392:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.093881:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144314240:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.093893:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144314752:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938471.093904:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1871643144315264:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938471.172404:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938471.172593:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125347072 00000100:00100000:0.0:1784938471.172602:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125347072 00000100:00100000:0.0:1784938471.172687:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:0.0:1784938471.172697:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:15584:x1871643125347072:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938471.172717:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938471.172763:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ef96c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b1e expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173029:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173047:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173061:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173076:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173083:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173090:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173271:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76200/0x26783cd1c59ef981 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173280:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76200/0x26783cd1c59ef981 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173287:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76200/0x26783cd1c59ef981 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938471.173330:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784938471.173334:0:17141:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938471.173371:0:17141:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76200/0x26783cd1c59ef981 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173390:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173397:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173404:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173410:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938471.173414:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173421:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173434:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:0.0:1784938471.173437:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938471.173441:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173447:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59ef973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173460:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173466:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173472:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173483:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938471.173495:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173501:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173509:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff910cef382e00) 00010000:00010000:0.0:1784938471.173512:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938471.173514:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173519:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59ef97a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173680:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76400/0x26783cd1c59ef96c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b1e expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173696:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76200/0x26783cd1c59ef981 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b1e expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.173705:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910cef382d00) 00010000:00010000:0.0:1784938471.173707:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938471.173710:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76200, rc 0) 00000100:00080000:2.0:1784938471.173840:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938471.176587:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:15584:x1871643125347072:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 3881us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.176600:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:1.0:1784938471.182417:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938471.183004:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125347200 00000100:00100000:2.0:1784938471.183015:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125347200 00000100:00100000:2.0:1784938471.183094:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:2.0:1784938471.183104:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:15584:x1871643125347200:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784938471.183192:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:15584:x1871643125347200:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 Request processed in 89us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.183200:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:2.0:1784938471.190590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938471.193080:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125347456 00000100:00100000:3.0:1784938471.193104:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125347456 00000100:00100000:1.0:1784938471.193287:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:1.0:1784938471.193314:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:15584:x1871643125347456:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938471.193337:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938471.193363:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ef988 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b25 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193506:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193521:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193536:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193566:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193575:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193582:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193728:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3c00/0x26783cd1c59ef99d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193737:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3c00/0x26783cd1c59ef99d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193745:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3c00/0x26783cd1c59ef99d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938471.193755:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1784938471.193936:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193954:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193961:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193968:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938471.193972:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193980:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.193992:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910cef382d00) 00010000:00010000:1.0:1784938471.193995:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938471.194000:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.194007:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d0a00/0x26783cd1c59ef98f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.194022:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.194028:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.194034:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.194040:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d020d1200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938471.194049:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.194057:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.194065:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff910bc73ab600) 00010000:00010000:1.0:1784938471.194067:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938471.194070:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.194076:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1200/0x26783cd1c59ef996 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.195582:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d020d1600/0x26783cd1c59ef988 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b25 expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.195608:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3c00/0x26783cd1c59ef99d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b25 expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.195617:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc73ab700) 00010000:00010000:1.0:1784938471.195620:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938471.195623:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa3c00, rc 0) 00000100:00100000:1.0:1784938471.195747:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+9:15584:x1871643125347456:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 2445us (5163us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784938471.195757:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:0.0:1784938471.200454:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.200540:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125347584 00000100:00100000:1.0:1784938471.200550:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125347584 00000100:00100000:1.0:1784938471.200602:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1784938471.200624:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+9:15584:x1871643125347584:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784938471.200756:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+9:15584:x1871643125347584:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 145us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.200764:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1784938471.207975:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938471.208981:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125347712 00000100:00100000:3.0:1784938471.209000:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125347712 00000100:00080000:2.0:1784938471.209053:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784938471.209088:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:3.0:1784938471.209099:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:15584:x1871643125347712:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1784938471.211279:0:17139:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2135us 00000100:00100000:3.0:1784938471.219674:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:15584:x1871643125347712:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 10567us (11698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938471.219697:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1784938471.238900:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.239185:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125347840 00000100:00100000:1.0:1784938471.239196:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125347840 00000100:00100000:1.0:1784938471.239291:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:1.0:1784938471.239302:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+9:15590:x1871643125347840:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938471.239326:0:19429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938471.239353:0:19429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b2c expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239427:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239444:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239456:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239519:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239528:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239535:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239578:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239592:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239599:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239605:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa3200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938471.239609:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239617:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239630:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938471.239633:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938471.239638:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239644:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239656:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239662:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239668:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239673:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa3800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938471.239682:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239689:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239697:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910bc73ab600) 00010000:00010000:1.0:1784938471.239699:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938471.239702:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239708:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239740:0:19429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b2c expref: 10 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239751:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938471.239753:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938471.239756:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b2c expref: 10 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.239764:0:19429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa2e00, rc 0) 00000100:00100000:1.0:1784938471.239821:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+9:15590:x1871643125347840:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 522us (931us total) trans 0 rc 301/301 00000100:00100000:1.0:1784938471.239828:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:2.0:1784938471.246861:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938471.246994:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125347968 00000100:00100000:0.0:1784938471.247005:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125347968 00000100:00100000:0.0:1784938471.247076:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:0.0:1784938471.247087:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+9:15590:x1871643125347968:12345-192.168.203.26@tcp:700:lfs.0 00000100:00100000:1.0:1784938471.247963:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+9:15590:x1871643125347968:12345-192.168.203.26@tcp:700:lfs.0 Request processed in 874us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.247977:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:0.0:1784938471.256144:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.256271:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125348224 00000100:00100000:1.0:1784938471.256281:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125348224 00000100:00100000:1.0:1784938471.256341:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:1.0:1784938471.256352:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+9:15590:x1871643125348224:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:1.0:1784938471.256411:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938471.256436:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59ef8d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28a99 expref: 9 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.256456:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938471.256461:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938471.256522:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.256535:0:17140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b09 expref: 5 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.256543:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.256575:0:17140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b09 expref: 5 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.256590:0:17140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b09 expref: 5 pid: 17141 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938471.256605:0:17140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb77100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17140:1871643144315776:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938471.256691:0:17140:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfa34900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938471.260061:0:17140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb77100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17140:1871643144315776:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938471.260098:0:17140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938471.261442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.261555:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125348352 00000100:00100000:1.0:1784938471.261564:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125348352 00010000:00010000:1.0:1784938471.261618:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b09 expref: 6 pid: 17141 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938471.261655:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:1.0:1784938471.261666:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:2393:x1871643125348352:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938471.261682:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938471.261689:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b09 expref: 6 pid: 17141 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.261704:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b09 expref: 6 pid: 17141 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.261727:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59ef918 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b09 expref: 6 pid: 17141 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.261744:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:1.0:1784938471.261749:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.261759:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.261766:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.261813:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938471.261838:0:17140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.261846:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938471.261866:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2393:x1871643125348352:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 200us (430us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938471.261867:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938471.261881:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00010000:00010000:3.0:1784938471.261884:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.261893:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784938471.262021:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784938471.263353:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263370:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263553:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938471.263681:0:17140:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000180bfd16 reply state 000000000a0185d7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263696:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263703:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:3.0:1784938471.263712:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938471.263716:0:17140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784938471.263721:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784938471.263731:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263738:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263744:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263749:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa2e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938471.263753:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263760:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263770:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910cc2a19400) 00010000:00010000:3.0:1784938471.263772:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938471.263776:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263782:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2e00/0x26783cd1c59ef9c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938471.263803:0:17140:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000180bfd16 reply state 000000000a0185d7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263812:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.263829:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910cc9af5e00) 00010000:00010000:3.0:1784938471.263831:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784938471.263834:0:17140:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784938471.263939:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+10:15590:x1871643125348224:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 7586us (7801us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784938471.263948:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:0.0:1784938471.352584:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.352690:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125348480 00000100:00100000:1.0:1784938471.352700:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125348480 00000100:00100000:1.0:1784938471.352766:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:1.0:1784938471.352777:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+10:15598:x1871643125348480:12345-192.168.203.26@tcp:101:lctl.0 00010000:00010000:1.0:1784938471.352802:0:19429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938471.352825:0:19429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b33 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.352891:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.352905:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.352916:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938471.352958:0:19429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784938471.352963:0:19429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938471.352995:0:19429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.353019:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b33 expref: 12 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.353056:0:19429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3200/0x26783cd1c59ef9dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b33 expref: 11 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.353065:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910bc73ab600) 00010000:00010000:1.0:1784938471.353068:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938471.353071:0:19429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa3200, rc 0) 00000100:00100000:1.0:1784938471.353139:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+11:15598:x1871643125348480:12345-192.168.203.26@tcp:101:lctl.0 Request processed in 366us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.353146:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:2.0:1784938471.397674:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938471.397807:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125348608 00000100:00100000:3.0:1784938471.398000:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125348608 00000100:00100000:3.0:1784938471.398109:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:3.0:1784938471.398120:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:15599:x1871643125348608:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1784938471.398143:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938471.398167:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59ef9e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b3a expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.398286:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ef9ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.398300:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ef9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.398310:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ef9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938471.398350:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784938471.398354:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784938471.398372:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ef9ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.398393:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59ef9e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b3a expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.398437:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0600/0x26783cd1c59ef9ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b3a expref: 6 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.398447:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910bc73ab600) 00010000:00010000:3.0:1784938471.398450:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938471.398454:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0600, rc 0) 00000100:00100000:3.0:1784938471.398528:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:15599:x1871643125348608:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 399us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938471.398535:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:0.0:1784938471.408016:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.408126:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125348736 00000100:00100000:1.0:1784938471.408135:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125348736 00000100:00100000:1.0:1784938471.408199:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:1.0:1784938471.408233:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53ab7f31-238a-42f3-8d14-599fa1c9b387+6:15599:x1871643125348736:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938471.408254:0:19429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938471.408274:0:19429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b41 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408332:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408345:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408355:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408363:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408383:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408390:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408667:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2000/0x26783cd1c59efa06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408676:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2000/0x26783cd1c59efa06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408683:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2000/0x26783cd1c59efa06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938471.408724:0:19429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784938471.408729:0:19429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938471.408749:0:19429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2000/0x26783cd1c59efa06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408763:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408769:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408775:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408782:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa2c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938471.408786:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408806:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408828:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910bc73ab600) 00010000:00010000:1.0:1784938471.408831:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938471.408836:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408843:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59ef9f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408857:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408863:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408869:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408873:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa3e00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938471.408876:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408881:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408888:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910cc9af5e00) 00010000:00010000:1.0:1784938471.408890:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938471.408893:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408909:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59ef9ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408937:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59ef9f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b41 expref: 8 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408951:0:19429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2000/0x26783cd1c59efa06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b41 expref: 7 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.408958:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:1.0:1784938471.408961:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938471.408963:0:19429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa2000, rc 0) 00000100:00100000:1.0:1784938471.409072:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53ab7f31-238a-42f3-8d14-599fa1c9b387+7:15599:x1871643125348736:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 864us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.409080:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:0.0:1784938471.413311:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938471.413407:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125348864 00000100:00100000:2.0:1784938471.413416:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125348864 00000100:00080000:1.0:1784938471.413775:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784938471.413793:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:2.0:1784938471.413804:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:15599:x1871643125348864:12345-192.168.203.26@tcp:900:lfs.0 00000100:00100000:2.0:1784938471.413889:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:15599:x1871643125348864:12345-192.168.203.26@tcp:900:lfs.0 Request processed in 87us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.413897:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:2.0:1784938471.417792:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.418045:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125349120 00000100:00100000:1.0:1784938471.418054:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125349120 00000100:00100000:1.0:1784938471.418149:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:1.0:1784938471.418160:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+7:15599:x1871643125349120:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938471.418181:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938471.418199:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59efa0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b48 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938471.418311:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784938471.418403:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59efa0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b48 expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.418430:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910bc73ab600) 00010000:00010000:1.0:1784938471.418433:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938471.418438:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59efa0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b48 expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.418450:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa3800, rc 0) 00000100:00100000:1.0:1784938471.418516:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+8:15599:x1871643125349120:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 359us (734us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1784938471.418523:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:0.0:1784938471.422103:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938471.422317:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125349376 00000100:00100000:2.0:1784938471.422327:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125349376 00000100:00100000:2.0:1784938471.422412:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:2.0:1784938471.422433:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53ab7f31-238a-42f3-8d14-599fa1c9b387+8:15599:x1871643125349376:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:2.0:1784938471.422504:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938471.422532:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2000/0x26783cd1c59efa06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b41 expref: 8 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.422559:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:2.0:1784938471.422566:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938471.422587:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.422600:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.422939:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938471.423147:0:17141:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbfd1b72 reply state 0000000068ad90d4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.423160:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.423166:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:2.0:1784938471.423169:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1784938471.423171:0:17141:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784938471.423179:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784938471.423284:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53ab7f31-238a-42f3-8d14-599fa1c9b387+9:15599:x1871643125349376:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 861us (1189us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1784938471.423291:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:0.0:1784938471.427459:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.427719:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125349632 00000100:00100000:1.0:1784938471.427729:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125349632 00000100:00100000:1.0:1784938471.427827:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1784938471.427838:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+9:15599:x1871643125349632:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938471.428059:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+10:15599:x1871643125349632:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 223us (609us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1784938471.428067:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:3.0:1784938471.432447:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938471.432730:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125349888 00000100:00100000:0.0:1784938471.432740:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125349888 00000100:00100000:0.0:1784938471.432800:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:0.0:1784938471.432809:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+10:15599:x1871643125349888:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1784938471.432832:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938471.432853:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76800/0x26783cd1c59efa22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b4f expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.432926:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.432941:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.432952:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.432963:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.432987:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.432994:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938471.433101:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784938471.433174:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433182:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433188:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433194:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b77a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938471.433199:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433206:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433249:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910bc73ab600) 00010000:00010000:0.0:1784938471.433253:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938471.433258:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433264:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433289:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433295:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433301:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433306:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910ce6b76600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:0.0:1784938471.433309:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433315:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433323:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910cc9af5e00) 00010000:00010000:0.0:1784938471.433325:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938471.433328:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433333:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433371:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76800/0x26783cd1c59efa22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b4f expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433382:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910bc73ab600) 00010000:00010000:0.0:1784938471.433384:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938471.433393:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76800/0x26783cd1c59efa22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b4f expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.433403:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b76800, rc 0) 00000100:00100000:0.0:1784938471.433470:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+11:15599:x1871643125349888:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 661us (1030us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1784938471.433478:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:0.0:1784938471.437303:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.437388:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125350016 00000100:00100000:1.0:1784938471.437397:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125350016 00000100:00100000:1.0:1784938471.437459:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:1.0:1784938471.437468:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53ab7f31-238a-42f3-8d14-599fa1c9b387+11:15599:x1871643125350016:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938471.437502:0:19429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938471.437524:0:19429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59efa3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b56 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.437872:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.437899:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.437911:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938471.437938:0:19429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784938471.437941:0:19429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938471.437958:0:19429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.437983:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3800/0x26783cd1c59efa3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b56 expref: 13 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.437998:0:19429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b56 expref: 12 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.438007:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:1.0:1784938471.438009:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938471.438012:0:19429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa3e00, rc 0) 00000100:00100000:1.0:1784938471.438073:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53ab7f31-238a-42f3-8d14-599fa1c9b387+12:15599:x1871643125350016:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 606us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938471.438081:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1784938471.443671:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938471.443750:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125350144 00000100:00100000:2.0:1784938471.443760:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125350144 00000100:00100000:2.0:1784938471.443802:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:2.0:1784938471.443811:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+12:15599:x1871643125350144:12345-192.168.203.26@tcp:37:lfs.0 00000100:00100000:2.0:1784938471.447047:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+12:15599:x1871643125350144:12345-192.168.203.26@tcp:37:lfs.0 Request processed in 3226us (3375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.447063:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:0.0:1784938471.457610:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.457696:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125350400 00000100:00100000:1.0:1784938471.457706:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125350400 00000100:00100000:1.0:1784938471.457764:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1784938471.457773:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01953c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+12:15599:x1871643125350400:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938471.458048:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01953c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+13:15599:x1871643125350400:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 275us (446us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1784938471.458070:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:0.0:1784938471.531917:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938471.531996:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125350528 00000100:00100000:3.0:1784938471.532007:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125350528 00000100:00100000:3.0:1784938471.532072:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:3.0:1784938471.532082:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+11:15605:x1871643125350528:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1784938471.532102:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938471.532123:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efa4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b5d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.532188:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.534632:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938471.534654:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535056:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535069:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535078:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535313:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59efa61 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535324:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59efa61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535332:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59efa61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938471.535372:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784938471.535377:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784938471.535413:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59efa61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535426:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535431:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535437:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535442:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0c00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938471.535446:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535453:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535463:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910bc73ab600) 00010000:00010000:2.0:1784938471.535472:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938471.535477:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535492:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efa53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535507:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535512:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535517:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535521:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938471.535524:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535529:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535536:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910cc9af5e00) 00010000:00010000:2.0:1784938471.535538:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938471.535540:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535546:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efa5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535580:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efa4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b5d expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535606:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1200/0x26783cd1c59efa61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b5d expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.535613:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:2.0:1784938471.535615:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938471.535617:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d1200, rc 0) 00000100:00100000:2.0:1784938471.535692:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+12:15605:x1871643125350528:12345-192.168.203.26@tcp:101:bash.0 Request processed in 3611us (3783us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.535701:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:3.0:1784938471.542432:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938471.543564:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125350656 00000100:00100000:0.0:1784938471.543581:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125350656 00000100:00100000:0.0:1784938471.543654:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1784938471.543664:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:15605:x1871643125350656:12345-192.168.203.26@tcp:900:bash.0 00000100:00100000:0.0:1784938471.543759:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:15605:x1871643125350656:12345-192.168.203.26@tcp:900:bash.0 Request processed in 96us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938471.543767:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1784938471.549840:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.549956:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125350912 00000100:00100000:1.0:1784938471.549972:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125350912 00000100:00100000:1.0:1784938471.550061:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:1.0:1784938471.550072:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+12:15605:x1871643125350912:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1784938471.550094:0:19429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938471.550117:0:19429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59efa68 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b64 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.550277:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.550295:0:19429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b56 expref: 12 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.550304:0:19429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.550342:0:19429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b56 expref: 12 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.550354:0:19429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b56 expref: 12 pid: 19429 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938471.550367:0:19429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb77100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19429:1871643144315904:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938471.550454:0:19429:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cdfa346c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938471.553915:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938471.554031:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125351040 00000100:00100000:3.0:1784938471.554048:0:17893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125351040 00010000:00010000:3.0:1784938471.554116:0:17893:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b56 expref: 13 pid: 19429 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938471.554336:0:19429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb77100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19429:1871643144315904:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938471.554358:0:19429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938471.554744:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1784938471.554822:0:17893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53ab7f31-238a-42f3-8d14-599fa1c9b387+13:2393:x1871643125351040:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938471.554848:0:17893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938471.554859:0:17893:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b56 expref: 13 pid: 19429 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.554873:0:17893:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b56 expref: 13 pid: 19429 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.554895:0:17893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3e00/0x26783cd1c59efa45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b56 expref: 13 pid: 19429 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.554909:0:17893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:2.0:1784938471.554921:0:17893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.554930:0:17893:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.554937:0:17893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.554968:0:17893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938471.555151:0:19429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555160:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555183:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555192:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555199:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555738:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555749:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555756:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938471.555767:0:19429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784938471.555793:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555800:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555806:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555824:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa3a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938471.555830:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555839:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555849:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:1.0:1784938471.555853:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938471.555857:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555863:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efa6f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938471.555876:0:19429:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000007ed14f3 reply state 00000000657bbdc9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555887:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555893:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff910bc73ab800) 00010000:00010000:1.0:1784938471.555895:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784938471.555898:0:19429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938471.555933:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59efa68 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b64 expref: 15 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555948:0:19429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b64 expref: 14 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.555967:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:1.0:1784938471.555969:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1784938471.555971:0:19429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa3600, rc 0) 00000100:00100000:2.0:1784938471.556083:0:17893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53ab7f31-238a-42f3-8d14-599fa1c9b387+12:2393:x1871643125351040:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1327us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.556096:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:1.0:1784938471.556324:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+15:15605:x1871643125350912:12345-192.168.203.26@tcp:101:bash.0 Request processed in 6253us (6499us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1784938471.556334:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:3.0:1784938471.576900:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938471.577011:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125351168 00000100:00100000:0.0:1784938471.577028:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125351168 00000100:00100000:0.0:1784938471.577120:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:0.0:1784938471.577149:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+15:15605:x1871643125351168:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1784938471.577186:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938471.577265:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b6b expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.577383:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.577401:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.577414:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938471.577494:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784938471.577499:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784938471.577529:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.577541:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.577575:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76600/0x26783cd1c59efa8b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b6b expref: 17 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.577599:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b6b expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.577608:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:0.0:1784938471.577611:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938471.577615:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910ce6b77a00, rc 0) 00000100:00100000:0.0:1784938471.579037:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+16:15605:x1871643125351168:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1893us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938471.579053:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:2.0:1784938471.581927:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.582048:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125351424 00000100:00100000:1.0:1784938471.582060:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125351424 00000100:00100000:1.0:1784938471.582120:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:1.0:1784938471.582131:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+16:15605:x1871643125351424:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:1.0:1784938471.582490:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+17:15605:x1871643125351424:12345-192.168.203.26@tcp:35:bash.0 Request processed in 350us (561us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1784938471.582499:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:2.0:1784938471.679858:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.680083:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125351680 00000100:00100000:1.0:1784938471.680095:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125351680 00000100:00100000:1.0:1784938471.680418:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:1.0:1784938471.680430:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+17:15615:x1871643125351680:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1784938471.680456:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938471.680476:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59efa99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b72 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938471.680583:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784938471.680674:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59efa99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b72 expref: 19 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.680706:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910bc73ab600) 00010000:00010000:1.0:1784938471.680710:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938471.680715:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2c00/0x26783cd1c59efa99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b72 expref: 19 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938471.680727:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa2c00, rc 0) 00000100:00100000:1.0:1784938471.680778:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+18:15615:x1871643125351680:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 351us (930us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1784938471.680786:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:3.0:1784938471.689771:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.689862:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125351936 00000100:00100000:1.0:1784938471.689871:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125351936 00000100:00100000:1.0:1784938471.689929:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:1.0:1784938471.689939:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+18:15615:x1871643125351936:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938471.690159:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+19:15615:x1871643125351936:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 221us (397us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1784938471.690167:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00010000:00010000:2.0:1784938471.711783:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938471.731752:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938471.732541:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125352192 00000100:00100000:2.0:1784938471.732555:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125352192 00000100:00100000:2.0:1784938471.732625:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:2.0:1784938471.732635:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+19:15618:x1871643125352192:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1784938471.732667:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938471.732689:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efaa7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b79 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.732793:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efaae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.732806:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efaae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.732817:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efaae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938471.732839:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784938471.732931:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efaa7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b79 expref: 22 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.732950:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efaae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b79 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.732959:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:2.0:1784938471.732962:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938471.732965:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0000, rc 0) 00000100:00100000:2.0:1784938471.735147:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+21:15618:x1871643125352192:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 2502us (3394us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1784938471.735158:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1784938471.738247:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938471.738291:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938471.738296:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125352320 00000100:00100000:2.0:1784938471.738307:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125352320 00000100:00100000:2.0:1784938471.738368:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:2.0:1784938471.738379:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+21:15618:x1871643125352320:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:2.0:1784938471.738443:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.738461:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.738473:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.738520:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.738539:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.738547:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.738553:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938471.738558:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.738565:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.738576:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:2.0:1784938471.738579:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938471.738583:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938471.738590:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efabc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938471.738680:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+21:15618:x1871643125352320:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 303us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938471.738688:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1784938471.738816:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125352448 00000100:00100000:0.0:1784938471.738821:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125352448 00000100:00100000:0.0:1784938471.738865:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:0.0:1784938471.738873:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+21:2395:x1871643125352448:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938471.738885:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938471.738900:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efaae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b79 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938471.738912:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:0.0:1784938471.738915:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938471.738943:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+20:2395:x1871643125352448:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 71us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938471.738951:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:3.0:1784938471.741683:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938471.741970:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125352704 00000100:00100000:1.0:1784938471.741980:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125352704 00000100:00100000:1.0:1784938471.742044:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:1.0:1784938471.742055:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+20:15618:x1871643125352704:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1784938471.744815:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+21:15618:x1871643125352704:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 2752us (3128us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1784938471.744829:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000040:00080000:3.0:1784938472.031956:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784938472.082682:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938472.082859:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125352960 00000100:00100000:1.0:1784938472.082880:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125352960 00000100:00100000:1.0:1784938472.082944:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1784938472.082954:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+21:15649:x1871643125352960:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:1.0:1784938472.082977:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938472.082996:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efac3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b80 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.083121:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3400/0x26783cd1c59efaca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.083137:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3400/0x26783cd1c59efaca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.083151:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3400/0x26783cd1c59efaca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938472.083162:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784938472.083364:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efac3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b80 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.083384:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3400/0x26783cd1c59efaca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b80 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.083393:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:1.0:1784938472.083396:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938472.083399:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa3400, rc 0) 00000100:00100000:1.0:1784938472.083465:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+23:15649:x1871643125352960:12345-192.168.203.26@tcp:101:cat.0 Request processed in 513us (794us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1784938472.083473:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:0.0:1784938472.089074:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938472.089152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938472.089255:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125353088 00000100:00100000:3.0:1784938472.089266:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125353088 00000100:00100000:3.0:1784938472.089330:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:3.0:1784938472.089340:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+23:2393:x1871643125353088:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938472.089365:0:17126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938472.089390:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3400/0x26783cd1c59efaca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b80 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.089410:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:3.0:1784938472.089414:0:17126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938472.089470:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+22:2393:x1871643125353088:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 131us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938472.089490:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1784938472.092815:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125353344 00000100:00100000:2.0:1784938472.092829:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125353344 00000100:00100000:2.0:1784938472.092890:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:2.0:1784938472.092900:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+22:15649:x1871643125353344:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:2.0:1784938472.093376:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+23:15649:x1871643125353344:12345-192.168.203.26@tcp:35:cat.0 Request processed in 475us (4222us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1784938472.093385:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000040:00080000:3.0:1784938472.160391:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784938472.167451:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938472.168723:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125353600 00000100:00100000:1.0:1784938472.168738:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125353600 00000100:00100000:1.0:1784938472.168805:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:1.0:1784938472.168815:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+23:15655:x1871643125353600:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:1.0:1784938472.168840:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938472.168871:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efad8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b87 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.168974:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.168989:0:17141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b64 expref: 24 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.168998:0:17141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b6b expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.169007:0:17141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.169039:0:17141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b6b expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.169052:0:17141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b6b expref: 24 pid: 17139 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938472.169066:0:17141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb75f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17141:1871643144316032:192.168.203.26@tcp:104: 00010000:00010000:1.0:1784938472.172111:0:17141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b64 expref: 24 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.172147:0:17141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b64 expref: 24 pid: 19429 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938472.172165:0:17141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17141:1871643144316160:192.168.203.26@tcp:104: 00000100:00100000:1.0:1784938472.172210:0:17141:0:(client.c:2702:ptlrpc_set_wait()) set ffff910bc674d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938472.183821:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.183871:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.183911:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125353728 00000100:00100000:2.0:1784938472.183920:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125353728 00010000:00010000:2.0:1784938472.183961:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b6b expref: 25 pid: 17139 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938472.183996:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125353856 00000100:00100000:2.0:1784938472.184000:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125353856 00010000:00010000:2.0:1784938472.184012:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b64 expref: 26 pid: 19429 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938472.184034:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:2.0:1784938472.184042:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+26:2392:x1871643125353728:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938472.184059:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938472.184065:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b6b expref: 26 pid: 17139 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.184078:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b6b expref: 26 pid: 17139 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.184101:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:2.0:1784938472.184107:0:17125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938472.184128:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00010000:00010000:2.0:1784938472.184139:0:17125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938472.184146:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc6769050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+26:2393:x1871643125353856:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938472.184150:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938472.184160:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938472.184170:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b64 expref: 26 pid: 19429 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938472.184183:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b64 expref: 26 pid: 19429 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938472.184197:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00000100:00100000:2.0:1784938472.184206:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+26:2392:x1871643125353728:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 163us (394us total) trans 0 rc 0/0 00010000:00010000:0.0:1784938472.184211:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938472.184244:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00010000:00010000:0.0:1784938472.184254:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938472.184264:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938472.184284:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938472.184305:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc6769050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+25:2393:x1871643125353856:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 166us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938472.184312:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00010000:00010000:3.0:1784938472.191449:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b77a00/0x26783cd1c59efa92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b6b expref: 24 pid: 17139 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938472.191599:0:17141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb75f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17141:1871643144316032:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938472.193266:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efa7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b64 expref: 23 pid: 19429 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938472.193297:0:17141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17141:1871643144316160:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938472.193327:0:17141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.193337:0:17141:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.193343:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938472.193363:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784938472.193868:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efad8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b87 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.193958:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2800/0x26783cd1c59efadf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b87 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.193968:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:2.0:1784938472.193984:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938472.193989:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa2800, rc 0) 00000100:00100000:2.0:1784938472.194057:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+23:15655:x1871643125353600:12345-192.168.203.26@tcp:101:dd.0 Request processed in 25242us (26613us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1784938472.194066:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:2.0:1784938472.200574:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938472.200819:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125353984 00000100:00100000:1.0:1784938472.200829:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125353984 00000100:00100000:1.0:1784938472.200900:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:1.0:1784938472.200910:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+23:15655:x1871643125353984:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:1.0:1784938472.200932:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938472.200954:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efaed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b8e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.200988:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.201004:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.201015:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.201136:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efaed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b8e expref: 25 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.201154:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b8e expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.201176:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:1.0:1784938472.201179:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784938472.201183:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa2600, rc 0) 00000100:00100000:1.0:1784938472.201560:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+24:15655:x1871643125353984:12345-192.168.203.26@tcp:101:dd.0 Request processed in 649us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938472.201567:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:0.0:1784938472.217923:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.218017:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125354240 00000100:00100000:2.0:1784938472.218028:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125354240 00000100:00100000:2.0:1784938472.218098:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:2.0:1784938472.218107:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+24:15655:x1871643125354240:12345-192.168.203.26@tcp:36:dd.0 00010000:00010000:2.0:1784938472.218680:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.218700:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.218712:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938472.218762:0:19429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1784938472.218788:0:19429:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da74e9d7 reply state 00000000efa03790 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.218801:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.218809:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:2.0:1784938472.218811:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784938472.218815:0:19429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938472.218902:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+27:15655:x1871643125354240:12345-192.168.203.26@tcp:36:dd.0 Request processed in 795us (988us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1784938472.218927:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000020:00080000:2.0:1784938472.218932:0:19429:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784938472.223035:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938472.223113:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125354368 00000100:00100000:3.0:1784938472.223122:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125354368 00000100:00100000:3.0:1784938472.223174:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:3.0:1784938472.223183:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+27:15655:x1871643125354368:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1784938472.223206:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938472.223466:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efb02 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b95 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.223586:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efb02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b95 expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.223795:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efb02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b95 expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.223819:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:3.0:1784938472.223822:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938472.223825:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1c00, rc 0) 00000100:00100000:3.0:1784938472.223953:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+28:15655:x1871643125354368:12345-192.168.203.26@tcp:101:dd.0 Request processed in 770us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938472.223960:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:0.0:1784938472.244469:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.244680:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125354624 00000100:00100000:2.0:1784938472.244690:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125354624 00000100:00100000:2.0:1784938472.244766:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:2.0:1784938472.244776:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+28:15655:x1871643125354624:12345-192.168.203.26@tcp:103:dd.0 00010000:00010000:2.0:1784938472.244792:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938472.244816:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efb02 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b95 expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938472.244836:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:2.0:1784938472.244842:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938472.244903:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+27:15655:x1871643125354624:12345-192.168.203.26@tcp:103:dd.0 Request processed in 128us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938472.244910:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:0.0:1784938472.252642:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938472.252734:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125354752 00000100:00100000:1.0:1784938472.252743:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125354752 00000100:00100000:1.0:1784938472.252805:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:1.0:1784938472.252815:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+27:15655:x1871643125354752:12345-192.168.203.26@tcp:58:dd.0 00010000:00010000:1.0:1784938472.252925:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.252943:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938472.252955:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784938472.255614:0:17141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938472.255660:0:17141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1784938472.256023:0:17141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1784938472.256133:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+27:15655:x1871643125354752:12345-192.168.203.26@tcp:58:dd.0 Request processed in 3311us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938472.256145:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:0.0:1784938472.262877:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938472.262968:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125354880 00000100:00100000:3.0:1784938472.262978:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125354880 00000100:00100000:3.0:1784938472.263052:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1784938472.263061:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+27:15655:x1871643125354880:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1784938472.263084:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938472.263105:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efb10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28b9c expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.263163:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.263174:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efb10 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b9c expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.263192:0:17139:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.263205:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efb10 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b9c expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.263272:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:3.0:1784938472.263275:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938472.263575:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efb10 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b9c expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938472.263586:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a0c00, rc 0) 00000100:00100000:2.0:1784938472.263735:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+28:15655:x1871643125354880:12345-192.168.203.26@tcp:101:dd.0 Request processed in 673us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938472.263744:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:2.0:1784938472.572211:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.572334:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.572374:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938472.572421:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125355392 00000100:00100000:3.0:1784938472.572431:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125355392 00000100:00100000:3.0:1784938472.572518:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:3.0:1784938472.572529:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2394:x1871643125355392:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1784938472.572615:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2394:x1871643125355392:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938472.572637:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1784938472.574126:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.574154:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.574187:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125355008 00000100:00100000:2.0:1784938472.574194:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125355008 00000100:00100000:2.0:1784938472.574248:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:2.0:1784938472.574257:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:2394:x1871643125355008:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938472.574313:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e7b61f8-1274-4958-9ca5-b2bb69fb1bc0+13:2394:x1871643125355008:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 58us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938472.574321:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:2.0:1784938472.574368:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938472.575561:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125355136 00000100:00100000:1.0:1784938472.575571:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125355136 00000100:00100000:1.0:1784938472.575591:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125355904 00000100:00100000:1.0:1784938472.575594:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125355904 00000100:00100000:2.0:1784938472.575642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938472.575650:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:1.0:1784938472.575660:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2394:x1871643125355904:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938472.575666:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125355520 00000100:00100000:2.0:1784938472.575672:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125355520 00000100:00100000:2.0:1784938472.575698:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1784938472.575706:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2394:x1871643125355520:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938472.575712:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2394:x1871643125355904:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 52us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938472.575734:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1784938472.575742:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2394:x1871643125355520:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938472.575750:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1784938472.575786:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125355648 00000100:00100000:2.0:1784938472.575787:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125355264 00000100:00100000:1.0:1784938472.575790:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125355648 00000100:00100000:2.0:1784938472.575794:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125355264 00000100:00100000:1.0:1784938472.575809:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:1.0:1784938472.575818:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+28:2394:x1871643125355136:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938472.575835:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1784938472.575844:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+12:2394:x1871643125355648:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938472.575875:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+12:2394:x1871643125355648:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 33us (3500us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938472.575880:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1784938472.575893:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:2.0:1784938472.575899:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2394:x1871643125355264:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938472.575920:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2394:x1871643125355264:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938472.575926:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:2.0:1784938472.575967:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.576002:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938472.576075:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125355776 00000100:00100000:2.0:1784938472.576079:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125355776 00000100:00100000:1.0:1784938472.576087:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125356032 00000100:00100000:1.0:1784938472.576093:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125356032 00000100:00100000:2.0:1784938472.576100:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:2.0:1784938472.576108:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2394:x1871643125355776:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1784938472.576129:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1784938472.576137:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2394:x1871643125356032:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1784938472.576144:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2394:x1871643125355776:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938472.576153:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:1.0:1784938472.576172:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53ab7f31-238a-42f3-8d14-599fa1c9b387+5:2394:x1871643125356032:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938472.576179:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1784938472.576331:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+28:2394:x1871643125355136:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 514us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938472.576341:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00080000:0.0:1784938472.577609:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938472.577616:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784938472.735447:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938473.119675:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938473.119702:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144316288:192.168.203.126@tcp:13:osp-pre-0-1.0 00000100:00100000:0.0:1784938473.121429:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938473.121591:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144316288 00000100:00100000:2.0:1784938473.121602:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144316288 00000100:00080000:0.0:1784938473.123556:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938473.123662:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:2.0:1784938473.123682:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144316288:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 00002000:00000024:2.0:1784938473.123717:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784938473.123792:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1871643144316288:12345-192.168.203.126@tcp:13:osp-pre-0-1.0 Request processed in 120us (2370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938473.123801:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 21 00000100:00100000:0.0:1784938473.124056:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1871643144316288:192.168.203.126@tcp:13:osp-pre-0-1.0 00000040:00080000:3.0:1784938473.183516:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784938473.183527:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938473.183558:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784938473.183567:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1784938473.183696:0:17173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd567480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17173:1871643144316416:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784938473.183832:0:17173:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd21a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938473.188630:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.188731:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125356160 00000100:00100000:2.0:1784938473.188740:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125356160 00000100:00100000:2.0:1784938473.188801:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:2.0:1784938473.188811:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+29:15656:x1871643125356160:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784938473.188839:0:17139:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784938473.188939:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+29:15656:x1871643125356160:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 130us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938473.188946:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00080000:0.0:1784938473.189191:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938473.191988:0:17173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd567480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17173:1871643144316416:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784938473.192872:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.193361:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125356288 00000100:00100000:1.0:1784938473.193371:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125356288 00000100:00100000:1.0:1784938473.193469:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:1.0:1784938473.193513:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+28:15656:x1871643125356288:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784938473.193608:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193626:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193641:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193729:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193737:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193744:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193767:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193775:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193782:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938473.193823:0:19429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784938473.193828:0:19429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938473.193841:0:19429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193851:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193857:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193863:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193879:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa2400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.193883:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193891:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193902:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc73ab700) 00010000:00010000:1.0:1784938473.193905:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938473.193910:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193916:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193928:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193934:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193940:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193944:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa3000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.193947:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193953:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193969:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff910bc73abf00) 00010000:00010000:1.0:1784938473.193972:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938473.193974:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193979:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb1e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193992:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.193998:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.194003:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.194008:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa3a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.194010:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.194015:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.194021:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:1.0:1784938473.194023:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938473.194026:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.194031:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938473.194541:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+28:15656:x1871643125356288:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 1028us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938473.194711:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1784938473.198331:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.198792:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125356544 00000100:00100000:2.0:1784938473.198804:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125356544 00000100:00100000:2.0:1784938473.198872:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:2.0:1784938473.198883:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+28:15656:x1871643125356544:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938473.198903:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938473.198924:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efb2c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28ba3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199032:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199048:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199060:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938473.199176:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784938473.199319:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199327:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199334:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199340:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:2.0:1784938473.199345:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199353:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199910:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:2.0:1784938473.199913:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784938473.199919:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199926:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199978:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efb2c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ba3 expref: 30 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.199989:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910bc73ab700) 00010000:00010000:2.0:1784938473.199991:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938473.199996:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efb2c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28ba3 expref: 30 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.200007:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0000, rc 0) 00000100:00100000:2.0:1784938473.200180:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+29:15656:x1871643125356544:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1298us (1966us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1784938473.200189:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:0.0:1784938473.206012:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938473.206100:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125356672 00000100:00100000:3.0:1784938473.206111:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125356672 00000100:00100000:3.0:1784938473.206175:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1784938473.206186:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+29:15656:x1871643125356672:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784938473.206780:0:17141:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784938473.206890:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+29:15656:x1871643125356672:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 705us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938473.206898:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:0.0:1784938473.212026:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.212586:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125356928 00000100:00100000:1.0:1784938473.212595:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125356928 00000100:00100000:1.0:1784938473.212664:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:1.0:1784938473.212674:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+29:15656:x1871643125356928:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938473.212695:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938473.212717:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb41 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28baa expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938473.213090:0:17140:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:1.0:1784938473.213097:0:17140:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1784938473.213121:0:17140:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1784938473.213320:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.213335:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.213347:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.213536:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb41 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28baa expref: 32 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.213554:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28baa expref: 31 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.213580:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910bc73abf00) 00010000:00010000:1.0:1784938473.213583:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938473.213586:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa3000, rc 0) 00000100:00100000:1.0:1784938473.213641:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+31:15656:x1871643125356928:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 968us (1624us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1784938473.213648:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:0.0:1784938473.218616:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.218672:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125357184 00000100:00100000:1.0:1784938473.218682:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125357184 00000100:00100000:1.0:1784938473.218740:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:1.0:1784938473.218750:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+31:15656:x1871643125357184:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784938473.218805:0:19429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938473.218829:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28baa expref: 31 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218845:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910bc73abf00) 00010000:00010000:1.0:1784938473.218855:0:19429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938473.218875:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218886:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218894:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218906:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218929:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218935:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218975:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218981:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218987:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.218993:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa2400 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.218997:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219005:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219013:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:1.0:1784938473.219015:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938473.219020:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219025:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb56 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219033:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219045:0:19429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219050:0:19429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219055:0:19429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa3600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.219059:0:19429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219075:0:19429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219084:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd6085805 (ffff910bc73ab100) 00010000:00010000:1.0:1784938473.219086:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938473.219089:0:19429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.219094:0:19429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb5d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd6085805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938473.219172:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+30:15656:x1871643125357184:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 423us (565us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938473.219179:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1784938473.222435:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.222694:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125357312 00000100:00100000:2.0:1784938473.222703:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125357312 00000100:00100000:2.0:1784938473.222764:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:2.0:1784938473.222773:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+30:15656:x1871643125357312:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938473.222792:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938473.222814:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efb64 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28bb1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.222867:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.222879:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.222892:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.222990:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efb64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb1 expref: 32 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.223008:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0a00/0x26783cd1c59efb6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb1 expref: 31 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.223016:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:2.0:1784938473.223019:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938473.223022:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cc97d0a00, rc 0) 00000100:00100000:2.0:1784938473.223181:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+31:15656:x1871643125357312:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 408us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938473.223188:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:0.0:1784938473.228383:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.228558:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125357568 00000100:00100000:1.0:1784938473.228567:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125357568 00000100:00100000:1.0:1784938473.228628:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:1.0:1784938473.228638:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+31:15656:x1871643125357568:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784938473.228721:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.228751:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.228762:0:19429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938473.228956:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1784938473.228980:0:19429:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 541260764586ns, next at 542260749338ns, rc = 0 00000004:00010000:1.0:1784938473.229031:0:19429:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e0634c2 reply state 00000000c280a3c0 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.229044:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.229052:0:19429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:1.0:1784938473.229055:0:19429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1784938473.229058:0:19429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938473.229171:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+33:15656:x1871643125357568:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 527us (806us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1784938473.229178:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:0.0:1784938473.234678:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.235055:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125357696 00000100:00100000:1.0:1784938473.235065:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125357696 00000100:00100000:1.0:1784938473.235128:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:1.0:1784938473.235139:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+33:15656:x1871643125357696:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938473.235172:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938473.235194:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28bb8 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.235313:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb8 expref: 34 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.235329:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb8 expref: 34 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.235347:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:1.0:1784938473.235351:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938473.235354:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa2400, rc 0) 00000100:00100000:1.0:1784938473.235409:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+34:15656:x1871643125357696:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 271us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938473.235417:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:0.0:1784938473.242045:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.242941:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125357824 00000100:00100000:2.0:1784938473.242951:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125357824 00000100:00100000:2.0:1784938473.243091:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1784938473.243160:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2392:x1871643125357824:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784938473.243646:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:2392:x1871643125357824:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 489us (1610us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1784938473.243668:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:0.0:1784938473.247058:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.247568:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125358080 00000100:00100000:1.0:1784938473.247578:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125358080 00000100:00100000:1.0:1784938473.247680:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:1.0:1784938473.247691:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+34:15656:x1871643125358080:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784938473.247935:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+35:15656:x1871643125358080:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 245us (885us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1784938473.247942:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:0.0:1784938473.250788:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938473.250974:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125358336 00000100:00100000:3.0:1784938473.250984:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125358336 00000100:00100000:3.0:1784938473.251045:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:3.0:1784938473.251054:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc587c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+35:15656:x1871643125358336:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784938473.251309:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc587c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+35:15656:x1871643125358336:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 255us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938473.251329:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:0.0:1784938473.254851:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.254945:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125358464 00000100:00100000:1.0:1784938473.254954:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125358464 00000100:00100000:1.0:1784938473.255023:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1784938473.255036:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+35:15656:x1871643125358464:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938473.255057:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938473.255097:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb80 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28bbf expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.255182:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.255197:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.255209:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938473.255290:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784938473.255310:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.255336:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3000/0x26783cd1c59efb80 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bbf expref: 37 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.255354:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bbf expref: 36 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.255385:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:1.0:1784938473.255388:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784938473.255392:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa3a00, rc 0) 00000100:00100000:1.0:1784938473.255442:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+36:15656:x1871643125358464:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 410us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938473.255450:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1784938473.259985:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.260064:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125358592 00000100:00100000:1.0:1784938473.260084:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125358592 00000100:00100000:1.0:1784938473.260154:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1784938473.260163:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:2393:x1871643125358592:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938473.260181:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938473.260204:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28bc6 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938473.260264:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63ffe9, blocks: 0x0 00010000:00010000:1.0:1784938473.260284:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1784938473.260289:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938473.260299:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bc6 expref: 7 pid: 19096 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.260321:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bc6 expref: 7 pid: 19096 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.260335:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cf2fa3400, rc 0) 00000100:00100000:1.0:1784938473.260401:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:2393:x1871643125358592:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 239us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938473.260408:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1784938473.264809:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.264955:0:19429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125358848 00000100:00100000:1.0:1784938473.264965:0:19429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125358848 00000100:00100000:1.0:1784938473.265030:0:19429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:1.0:1784938473.265040:0:19429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+36:15656:x1871643125358848:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784938473.265546:0:19429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+36:15656:x1871643125358848:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 505us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938473.265554:0:19429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:0.0:1784938473.269858:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.270140:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125358976 00000100:00100000:1.0:1784938473.270149:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125358976 00000100:00100000:1.0:1784938473.270315:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:1.0:1784938473.270326:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+36:15656:x1871643125358976:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784938473.272354:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00010000:00010000:1.0:1784938473.272606:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272622:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272630:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272636:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a0200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.272640:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272648:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272663:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910cc9af5e00) 00010000:00010000:1.0:1784938473.272666:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938473.272670:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272676:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59ef9c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272697:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272712:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272719:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272723:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.272726:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272731:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272739:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:1.0:1784938473.272741:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938473.272744:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272748:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59ef9ce lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272762:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272768:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272774:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272779:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa2200 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.272788:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272794:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272803:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff910bc73ab800) 00010000:00010000:1.0:1784938473.272805:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938473.272807:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272813:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2200/0x26783cd1c59efa76 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272829:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272835:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272841:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272846:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.272849:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272855:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272862:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:1.0:1784938473.272864:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938473.272872:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272879:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efafb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272893:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272899:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272904:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272908:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa3600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:1.0:1784938473.272911:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272916:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272924:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:1.0:1784938473.272926:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784938473.272929:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.272935:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3600/0x26783cd1c59efb72 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938473.273040:0:17119:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1784938473.273137:0:17119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1784938473.273249:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.273258:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.273264:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.273269:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0600 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938473.273272:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.273279:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.273287:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910cc9af5500) 00010000:00010000:3.0:1784938473.273289:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1784938473.273292:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.273298:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0600/0x26783cd1c59efa1b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938473.273861:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+15:15656:x1871643125358976:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 3533us (4007us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938473.273871:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:2.0:1784938473.273934:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938473.273950:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144316544:192.168.203.126@tcp:2:osp-syn-1-0.0 00000100:00100000:0.0:1784938473.276968:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938473.277336:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144316544 00000100:00100000:1.0:1784938473.277345:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144316544 00000100:00100000:1.0:1784938473.277405:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:1.0:1784938473.277414:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144316544:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 00000100:00080000:0.0:1784938473.277515:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1784938473.277561:0:18648:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784938473.277565:0:18648:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1784938473.277567:0:18648:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784938473.277569:0:18648:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1784938473 -> 1784938473 00002000:00010000:1.0:1784938473.277572:0:18648:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1784938473.277635:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1871643144316544:12345-192.168.203.126@tcp:2:osp-syn-1-0.0 Request processed in 221us (674us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1784938473.277644:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 26 00000004:00080000:2.0:1784938473.278173:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910cefcb4700/2, rc 0, transno 8589934596 00000100:00100000:2.0:1784938473.278183:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144316544:192.168.203.126@tcp:2:osp-syn-1-0.0 00000100:00100000:2.0:1784938473.278279:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938473.278342:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125359104 00000100:00100000:3.0:1784938473.278347:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125359104 00000100:00100000:3.0:1784938473.278582:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:3.0:1784938473.278602:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:2393:x1871643125359104:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784938473.278664:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:2393:x1871643125359104:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 73us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938473.278681:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:3.0:1784938473.290262:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938473.290497:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125359360 00000100:00100000:0.0:1784938473.290508:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125359360 00000100:00100000:0.0:1784938473.290573:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:0.0:1784938473.290584:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+15:15656:x1871643125359360:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784938473.290637:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938473.290663:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa3a00/0x26783cd1c59efb87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bbf expref: 15 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.290699:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:0.0:1784938473.290705:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938473.290734:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59efb95 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.290746:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59efb95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.290757:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59efb95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938473.292084:0:17141:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006aac5ad9 reply state 0000000025d96e44 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59efb95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.292101:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910ce6b76c00/0x26783cd1c59efb95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.292109:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:0.0:1784938473.292111:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784938473.292115:0:17141:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938473.292243:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+16:15656:x1871643125359360:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 1658us (2033us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1784938473.292252:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:0.0:1784938473.300493:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.300575:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125359488 00000100:00100000:2.0:1784938473.300586:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125359488 00000100:00100000:2.0:1784938473.300678:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:2.0:1784938473.300689:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+7:2393:x1871643125359488:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784938473.300837:0:18646:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784938473.300841:0:18646:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1784938471 00002000:00010000:2.0:1784938473.300843:0:18646:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1784938471 00002000:00010000:2.0:1784938473.300846:0:18646:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1784938473 -> 1784938471 00002000:00010000:2.0:1784938473.300848:0:18646:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784938473.300913:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+8:2393:x1871643125359488:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 225us (442us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1784938473.300920:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:0.0:1784938473.305924:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.308674:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125359616 00000100:00100000:2.0:1784938473.308690:0:18649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125359616 00000100:00100000:2.0:1784938473.308767:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:2.0:1784938473.308778:0:18649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+8:2392:x1871643125359616:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784938473.308830:0:18649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.308865:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938473.308870:0:18649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938473.308877:0:18649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.308892:0:18649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.308919:0:18649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.308933:0:18649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.308941:0:18649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.308948:0:18649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938473.308952:0:18649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.308960:0:18649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.308975:0:18649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.308990:0:18649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069850173/0x26783cd1c59efb9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.309130:0:18649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+8:2392:x1871643125359616:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 353us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938473.309138:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:0.0:1784938473.313322:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.314329:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125359872 00000100:00100000:2.0:1784938473.314341:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125359872 00000100:00100000:2.0:1784938473.314406:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:2.0:1784938473.314417:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+16:15656:x1871643125359872:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784938473.314518:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.314536:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b8e expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.314546:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.314581:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b8e expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.314596:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b8e expref: 16 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.314610:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17139:1871643144316672:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938473.314698:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4d540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938473.318580:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17139:1871643144316672:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938473.318611:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938473.319080:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.319152:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125360000 00000100:00100000:2.0:1784938473.319160:0:17893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125360000 00010000:00010000:2.0:1784938473.319195:0:17893:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b8e expref: 17 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938473.319256:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1784938473.319267:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+17:2392:x1871643125360000:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938473.319297:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938473.319305:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b8e expref: 17 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.319319:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b8e expref: 17 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.319340:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2600/0x26783cd1c59efaf4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b8e expref: 17 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.319352:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:0.0:1784938473.319356:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efb10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b9c expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.319366:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.319374:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.319381:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.319411:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938473.319442:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.319450:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938473.319480:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+16:2392:x1871643125360000:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 203us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938473.319739:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00010000:00010000:2.0:1784938473.320156:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.320171:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb8 expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.320179:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.320201:0:17139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb8 expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.320211:0:17139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb8 expref: 16 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.320260:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17139:1871643144316800:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938473.320362:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938473.324652:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17139:1871643144316800:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938473.324682:0:17139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938473.324878:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.325489:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125360128 00000100:00100000:2.0:1784938473.325498:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125360128 00010000:00010000:2.0:1784938473.325533:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb8 expref: 17 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.325617:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1784938473.325627:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+17:2393:x1871643125360128:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938473.325644:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938473.325651:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb8 expref: 17 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.325664:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb8 expref: 17 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.325685:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2400/0x26783cd1c59efb79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bb8 expref: 17 pid: 17140 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.325700:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:2.0:1784938473.325705:0:17125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.325727:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.325735:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.325768:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938473.325826:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+16:2393:x1871643125360128:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 200us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938473.325834:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00010000:00010000:0.0:1784938473.326617:0:17139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938473.326641:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938473.326757:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1784938473.326866:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1784938473.326902:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1784938473.326974:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefcb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17139:1871643144316928:192.168.203.126@tcp:1000:mdt00_000.0 00000100:00100000:0.0:1784938473.329295:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cc679af00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938473.329523:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1784938473.329902:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144316928 00000100:00100000:3.0:1784938473.329911:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144316928 00000100:00100000:3.0:1784938473.329968:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00100000:3.0:1784938473.329977:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17139:x1871643144316928:12345-192.168.203.126@tcp:1000:mdt00_000.0 00000100:00100000:3.0:1784938473.330085:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17139:x1871643144316928:12345-192.168.203.126@tcp:1000:mdt00_000.0 Request processed in 109us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938473.330093:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 57 00000100:00100000:3.0:1784938473.330775:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefcb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17139:1871643144316928:192.168.203.126@tcp:1000:mdt00_000.0 00000001:00080000:3.0:1784938473.330957:0:17139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1784938473.331026:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd564000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17139:1871643144317056:192.168.203.126@tcp:1000:mdt00_000.0 00000100:00100000:3.0:1784938473.331086:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019cff00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938473.331462:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938473.332045:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144317056 00000100:00100000:2.0:1784938473.332053:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144317056 00000100:00100000:2.0:1784938473.332101:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:2.0:1784938473.332110:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17139:x1871643144317056:12345-192.168.203.126@tcp:1000:mdt00_000.0 00000100:00100000:2.0:1784938473.333780:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17139:x1871643144317056:12345-192.168.203.126@tcp:1000:mdt00_000.0 Request processed in 1664us (2312us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1784938473.333793:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 58 00000100:00100000:3.0:1784938473.336373:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd564000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17139:1871643144317056:192.168.203.126@tcp:1000:mdt00_000.0 00010000:00010000:3.0:1784938473.336432:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336442:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336449:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336456:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0000 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938473.336459:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336494:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336511:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:3.0:1784938473.336513:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938473.336518:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336524:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0000/0x26783cd1c59efbaa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336572:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336578:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336583:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336587:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cf2fa2a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938473.336590:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336595:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336603:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:3.0:1784938473.336605:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938473.336610:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efb10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b9c expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336631:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efb10 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b9c expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336640:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efb10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b9c expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.336702:0:17139:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0c00/0x26783cd1c59efb10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28b9c expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938473.336716:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd566d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17139:1871643144317184:192.168.203.26@tcp:105: 00000100:00100000:3.0:1784938473.336791:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff910d019cf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938473.345760:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938473.345900:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd566d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17139:1871643144317184:192.168.203.26@tcp:105: 00010000:00010000:3.0:1784938473.345927:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.345937:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cf2fa2a00/0x26783cd1c59efb09 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.345968:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.345981:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.345992:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346002:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346022:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346028:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346033:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cfd1a1a00 already unused, calling callback (ffffffffc1b054f0) 00010000:00010000:3.0:1784938473.346037:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346044:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346056:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:3.0:1784938473.346059:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938473.346062:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346068:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1a00/0x26783cd1c59efbb1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346079:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346084:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346090:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346095:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0800 already unused, calling callback (ffffffffc1b054f0) 00000100:00100000:1.0:1784938473.346102:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125360256 00010000:00010000:3.0:1784938473.346103:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346109:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938473.346110:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125360256 00010000:00010000:3.0:1784938473.346117:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:3.0:1784938473.346119:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784938473.346121:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.346127:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d0800/0x26783cd1c59efba3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938473.346159:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:1.0:1784938473.346167:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01951050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+20:15655:x1871643125360256:12345-192.168.203.26@tcp:49:dd.0 00000100:00100000:1.0:1784938473.346310:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01951050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+20:15655:x1871643125360256:12345-192.168.203.26@tcp:49:dd.0 Request processed in 143us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938473.346317:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000040:00080000:3.0:1784938473.346360:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784938473.346364:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938473.346389:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784938473.346395:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1784938473.346453:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+19:15656:x1871643125359872:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 32038us (33140us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1784938473.346461:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000020:00080000:3.0:1784938473.346465:0:17139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1784938473.349731:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.349823:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125360512 00000100:00100000:2.0:1784938473.349832:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125360512 00000100:00100000:2.0:1784938473.349891:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:2.0:1784938473.349900:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+19:15656:x1871643125360512:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784938473.350154:0:17143:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784938473.350186:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1784938473.350255:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.350286:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.350299:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.350307:0:17143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.350314:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.350320:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.350340:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938473.350362:0:17128:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938473.350369:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.350385:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:3.0:1784938473.350388:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.350395:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.350413:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910ccee40000) 00010000:00010000:3.0:1784938473.350415:0:17128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938473.350420:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.350425:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+21:15656:x1871643125360512:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 526us (704us total) trans 8589934622 rc 0/0 00010000:00010000:3.0:1784938473.350426:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cc97d1000/0x26783cd1c59efbb8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.350432:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000020:00080000:2.0:1784938473.350437:0:17143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784938473.350439:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938473.350440:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938473.350442:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938473.351751:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1784938473.351824:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125360640 00000100:00100000:3.0:1784938473.351832:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125360640 00000100:00100000:3.0:1784938473.351929:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1784938473.351939:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+21:15655:x1871643125360640:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1784938473.351958:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938473.351976:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59efbbf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x25e6867e27a28bcd expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.352008:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efbc6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.352020:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.352031:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.352357:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a0200/0x26783cd1c59efbbf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bcd expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.352388:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910cfd1a1c00/0x26783cd1c59efbc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bcd expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938473.352397:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910bc73abc00) 00010000:00010000:3.0:1784938473.352400:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784938473.352404:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910cfd1a1c00, rc 0) 00000100:00100000:3.0:1784938473.352456:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+22:15655:x1871643125360640:12345-192.168.203.26@tcp:101:dd.0 Request processed in 517us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938473.352463:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:0.0:1784938473.521514:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1784938473.521576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1784938473.521755:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125360768 00000100:00100000:2.0:1784938473.521766:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125360768 00000100:00100000:2.0:1784938473.521830:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125360896 00000100:00100000:2.0:1784938473.521834:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125360896 00000100:00100000:2.0:1784938473.521855:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:2.0:1784938473.521864:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+9:2395:x1871643125360768:12345-192.168.203.26@tcp:4:dd.0 00010000:00010000:2.0:1784938473.521898:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.521936:0:18652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bc6 expref: 9 pid: 19096 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.521945:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938473.521949:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938473.521954:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.522009:0:18652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bc6 expref: 9 pid: 19096 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.522024:0:18652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bc6 expref: 9 pid: 19096 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.522040:0:18652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18652:1871643144317312:192.168.203.26@tcp:104: 00000100:00100000:2.0:1784938473.522138:0:18652:0:(client.c:2702:ptlrpc_set_wait()) set ffff910cd1d4df00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938473.526292:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1784938473.526815:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643125361024 00000100:00100000:1.0:1784938473.526826:0:17893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643125361024 00010000:00010000:1.0:1784938473.526865:0:17893:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bc6 expref: 10 pid: 19096 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938473.526907:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1784938473.526931:0:17893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+10:2392:x1871643125361024:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938473.526947:0:17893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938473.526968:0:17893:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bc6 expref: 10 pid: 19096 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.526984:0:17893:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bc6 expref: 10 pid: 19096 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.527007:0:17893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938473.527012:0:17893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938473.527018:0:17893:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.527029:0:17893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938473.527049:0:17893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938473.527109:0:17893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+10:2392:x1871643125361024:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 179us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938473.527117:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00010000:00010000:2.0:1784938473.527900:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019bd75fc/0x26783cd1c59efb8e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x25e6867e27a28bc6 expref: 9 pid: 19096 timeout: 641 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.527917:0:18652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18652:1871643144317312:192.168.203.26@tcp:104: 00010000:00010000:2.0:1784938473.527936:0:18652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.527946:0:18652:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.527963:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938473.623832:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1784938473.623857:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1784938473.624400:0:18652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1784938473.624407:0:18652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1784938471 -> 1784938473 00002000:00010000:2.0:1784938473.624410:0:18652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1784938471 -> 1784938473 00002000:00010000:2.0:1784938473.624413:0:18652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1784938473.624437:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.624452:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.624463:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.624874:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d1000 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938473.624881:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.624891:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.624917:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.624955:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1f6faa1/0x26783cd1c59efbcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.625122:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+6:2395:x1871643125360768:12345-192.168.203.26@tcp:4:dd.0 Request processed in 103251us (103609us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1784938473.625135:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:2.0:1784938473.625183:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1784938473.625197:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2395:x1871643125360896:12345-192.168.203.26@tcp:4:dd.0 00002000:00010000:2.0:1784938473.625316:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a63ffe9, atime: 0x6a63ffe7, ctime: 0x6a63ffe9, blocks: 0x2000 00010000:00010000:2.0:1784938473.625325:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.625340:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=541s v=(0 0) 00010000:00010000:2.0:1784938473.625345:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938473.625353:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.626465:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938473.708782:0:19463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1784938473.711086:0:18652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1784938473.711100:0:18652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1784938473.711124:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.711169:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.711179:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.711187:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910cc97d0600 already unused, calling callback (ffffffffc0f0e4a0) 00010000:00010000:2.0:1784938473.711193:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.711203:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.711265:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938473.711274:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1bce8ec/0x26783cd1c59efbd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938473.711565:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dfba5c34-e2f4-4d66-8b34-841a4dc3ccc5+5:2395:x1871643125360896:12345-192.168.203.26@tcp:4:dd.0 Request processed in 86365us (189979us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784938473.711578:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00010000:00010000:2.0:1784938473.761009:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938474.143750:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cffb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144317440:192.168.203.126@tcp:41:osp-pre-1-0.0 00000100:00100000:1.0:1784938474.144119:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938474.145109:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144317568:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:1.0:1784938474.145646:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938474.145692:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144317440 00000100:00100000:1.0:1784938474.145711:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144317440 00000100:00100000:3.0:1784938474.145727:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144317568 00000100:00100000:3.0:1784938474.145738:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144317568 00000100:00100000:3.0:1784938474.145799:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 59 00000100:00100000:3.0:1784938474.145812:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144317568:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 00000004:00000024:3.0:1784938474.145860:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1784938474.145941:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1871643144317568:12345-192.168.203.126@tcp:41:osp-pre-0-1.0 Request processed in 132us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938474.145949:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 59 00000100:00100000:3.0:1784938474.145968:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:3.0:1784938474.145984:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144317440:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 00000004:00000024:3.0:1784938474.146004:0:17879:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784938474.146035:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144317440:12345-192.168.203.126@tcp:41:osp-pre-1-0.0 Request processed in 61us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938474.146041:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 60 00000100:00100000:0.0:1784938474.146302:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1871643144317568:192.168.203.126@tcp:41:osp-pre-0-1.0 00000100:00100000:0.0:1784938474.146402:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cffb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144317440:192.168.203.126@tcp:41:osp-pre-1-0.0 00010000:00010000:0.0:1784938474.783710:0:18295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938475.055887:0:20317:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1784938475.168352:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144317696:192.168.203.126@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938475.168972:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938475.169009:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144317696 00000100:00100000:2.0:1784938475.169016:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144317696 00000100:00100000:2.0:1784938475.169064:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00100000:2.0:1784938475.169074:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144317696:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938475.169238:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784938475.169284:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144317696:12345-192.168.203.126@tcp:13:osp-pre-0-0.0 Request processed in 211us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938475.169291:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 22 00000100:00080000:2.0:1784938475.169314:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938475.169925:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144317696:192.168.203.126@tcp:13:osp-pre-0-0.0 00010000:00010000:3.0:1784938475.807369:0:17128:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938476.191442:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938476.191492:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cd2049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144317824:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938476.191736:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144317952:192.168.203.126@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938476.192109:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144318208:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.192728:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144318464:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.192765:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144318976:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.192790:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144319488:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.192842:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1784938476.192851:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144318080:0@lo:400:kworker.0 00000100:00100000:0.0:1784938476.192906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938476.192955:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144318592:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.192984:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144319104:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.193010:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144319616:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.193095:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938476.193534:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144318720:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938476.193827:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cefc44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144319232:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938476.193870:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784938476.193879:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144318336:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938476.193911:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144318848:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938476.193939:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff910cfd4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144319360:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938476.195003:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938476.195046:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938476.195070:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938476.195096:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938476.195122:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938476.195165:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1784938476.195204:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144317824 00000100:00100000:2.0:1784938476.195243:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144317824 00000100:00100000:2.0:1784938476.195316:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144317952 00000100:00100000:2.0:1784938476.195320:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144317952 00000100:00100000:2.0:1784938476.195343:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:2.0:1784938476.195355:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144317824:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 00002000:00000024:2.0:1784938476.195402:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1784938476.195815:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144317824:12345-192.168.203.126@tcp:13:osp-pre-1-1.0 Request processed in 460us (2718us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938476.195824:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:2.0:1784938476.195850:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:2.0:1784938476.195858:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144317952:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938476.195870:0:18651:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1784938476.197799:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144317952:12345-192.168.203.126@tcp:13:osp-pre-1-0.0 Request processed in 1934us (2794us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938476.197810:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144318080 00000100:00100000:2.0:1784938476.197819:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:1.0:1784938476.197828:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144318080 00000100:00100000:2.0:1784938476.197883:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144318464 00000100:00100000:2.0:1784938476.197892:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144318464 00000100:00100000:1.0:1784938476.197899:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784938476.197918:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd70e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3640:x1871643144318080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938476.197939:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144318976 00000100:00100000:2.0:1784938476.197945:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144318976 00000100:00100000:2.0:1784938476.197980:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:2.0:1784938476.197990:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144318464:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.198026:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd70e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc+24:3640:x1871643144318080:12345-0@lo:400:kworker.0 Request processed in 115us (5118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938476.198041:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1871643144318464:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 48us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938476.198041:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784938476.198082:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938476.198140:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22975a70-c1d1-4a2e-b374-5f2d7bbbf8fc:3640:1871643144318080:0@lo:400:kworker.0 00000100:00100000:2.0:1784938476.198612:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 23 00000100:00100000:2.0:1784938476.198646:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00100000:2.0:1784938476.198660:0:18648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144318976:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938476.198896:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144319488 00000100:00100000:3.0:1784938476.198904:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144319488 00000100:00100000:3.0:1784938476.198940:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144318592 00000100:00100000:3.0:1784938476.198943:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144318592 00000100:00100000:3.0:1784938476.198955:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144319616 00000100:00100000:3.0:1784938476.198957:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144319616 00000100:00100000:3.0:1784938476.198970:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144319360 00000100:00100000:3.0:1784938476.198973:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144319360 00000100:00100000:3.0:1784938476.198988:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:3.0:1784938476.198995:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd204ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144319488:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938476.199029:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1871643144319488:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 34us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938476.199037:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:3.0:1784938476.199051:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 63 00000100:00100000:3.0:1784938476.199057:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cd2049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144318592:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938476.199092:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd2049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1871643144318592:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 24us (3958us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938476.199099:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 63 00000100:00100000:3.0:1784938476.199112:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 64 00000100:00100000:3.0:1784938476.199118:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cfd45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144319616:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938476.199144:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cfd45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1871643144319616:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 27us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938476.199150:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 64 00000100:00100000:3.0:1784938476.199161:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 65 00000100:00100000:3.0:1784938476.199167:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910cefcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144319360:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:3.0:1784938476.199189:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cefcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1871643144319360:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 22us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938476.199205:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 65 00000100:00100000:0.0:1784938476.203327:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938476.203366:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938476.203389:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938476.203411:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938476.203508:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cd2049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144317824:192.168.203.126@tcp:13:osp-pre-1-1.0 00000100:00100000:0.0:1784938476.203525:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:0.0:1784938476.203567:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1784938476.203594:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144318208 00000100:00100000:1.0:1784938476.203603:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144318208 00000100:00100000:1.0:1784938476.203669:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144318720 00000100:00100000:1.0:1784938476.203673:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144318720 00000100:00100000:0.0:1784938476.203684:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 61 00000100:00100000:0.0:1784938476.203703:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144318208:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.203873:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144318208:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 176us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938476.203931:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 61 00000100:00100000:1.0:1784938476.203948:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:0.0:1784938476.203973:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144319104 00000100:00100000:0.0:1784938476.203982:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144319104 00000100:00100000:0.0:1784938476.204017:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144319232 00000100:00100000:0.0:1784938476.204020:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144319232 00000100:00100000:0.0:1784938476.204041:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 66 00000100:00100000:0.0:1784938476.204048:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144319104:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.204092:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1871643144319104:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 44us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938476.204100:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 66 00000100:00100000:0.0:1784938476.204177:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 67 00000100:00100000:0.0:1784938476.204188:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144319232:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.204245:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1871643144319232:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 59us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938476.204255:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 67 00000100:00100000:0.0:1784938476.204279:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144318336 00000100:00100000:0.0:1784938476.204286:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144318336 00000100:00100000:1.0:1784938476.204288:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144318720:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.204309:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643144318848 00000100:00100000:0.0:1784938476.204315:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643144318848 00000100:00100000:0.0:1784938476.204339:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:0.0:1784938476.204347:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144318336:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.204376:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144318720:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 414us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938476.204386:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 62 00000100:00100000:0.0:1784938476.204393:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1871643144318336:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 42us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938476.204405:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 25 00000100:00100000:0.0:1784938476.204425:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:1.0:1784938476.204468:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1871643144318592:192.168.203.126@tcp:400:kworker.0 00010000:00080000:1.0:1784938476.204488:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4b8700 x1871643144319616/t0(0) o400->lustre-MDT0001-lwp-OST0001@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938476.204500:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1871643144319616:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.204508:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144318848:12345-192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.204537:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1784938476.204543:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910cefcb4700, transno 8589934596 00000004:00080000:1.0:1784938476.204558:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1784938476.204583:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144318464:192.168.203.126@tcp:400:kworker.0 00000100:00100000:0.0:1784938476.204586:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910bc77c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1871643144318848:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 149us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938476.204598:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 26 00000100:00100000:1.0:1784938476.204608:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1871643144319488:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.204629:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1871643144317952:192.168.203.126@tcp:13:osp-pre-1-0.0 00010000:00080000:1.0:1784938476.204681:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff910cfd4ba300 x1871643144319360/t0(0) o400->lustre-MDT0001-lwp-OST0000@192.168.203.126@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938476.204704:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1871643144319360:192.168.203.126@tcp:400:kworker.0 00000100:00100000:2.0:1784938476.204988:0:18648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff910cd204bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1871643144318976:12345-192.168.203.126@tcp:400:kworker.0 Request processed in 6329us (9911us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938476.204999:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 24 00000100:00080000:2.0:1784938476.205046:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938476.205052:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784938476.205057:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938476.205060:0:17135:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938476.205120:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1871643144319104:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.205132:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1871643144318976:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.206166:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144318336:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.206180:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144318848:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.206193:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1871643144318208:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.206203:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cfd565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1871643144318720:192.168.203.126@tcp:400:kworker.0 00000100:00100000:1.0:1784938476.206244:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff910cefc44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1871643144319232:192.168.203.126@tcp:400:kworker.0 Debug log: 43364 lines, 43364 kept, 0 dropped, 0 bad.